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Chapter 3 


Discrete-Time Signals and 
Fourier Series Representation 


Peter Gustav Lejeune Dirichlet 
1805 - 1859 


Johann Peter Gustav Lejeune Dirichlet was a German mathematician who made deep con- 
tributions to number theory, and to the theory of Fourier series and other topics in math- 
ematical analysis; he is credited with being one of the first mathematicians to give the 
modern formal definition of a function. In 1829, Dirichlet published a famous memoir giv- 
ing the conditions, showing for which functions the convergence of the Fourier series holds. 
Before Dirichlet’s solution, not only Fourier, but also Poisson and Cauchy had tried unsuc- 
cessfully to find a rigorous proof of convergence. The memoir introduced Dirichlet’s test for 
the convergence of series. It also introduced the Dirichlet function as an example that not 
any function is integrable (the definite integral was still a developing topic at the time) and, 
in the proof of the theorem for the Fourier series, it introduced the Dirichlet kernel and the 
Dirichlet integral. — From Wikipedia 
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Fourier Series and Discrete-time Signals 


In the previous two chapters, we discussed the Fourier series as applied to CT signals. 
We saw that the Fourier series can be used to create a representation of any periodic 
signal. This representation is made using the sine and cosine functions or with complex 
exponentials. Both forms are equivalent. In the previous two chapters, the discussion 
was limited to continuous time (CT) signals. In this chapter we will discuss Fourier 
series analysis as applied to discrete time (DT) signals. 


Discrete signals are different 


Although some data are naturally discrete such, as stock prices, number of students in 
a class, etc., many electronic signals we work with are sampled from analog signals, 
for example, voice, music, and medical/biological signals. The discrete signals are 
generated from analog signals by a process called sampling. This is also known as 
Analog-to-Digital conversion. The generation of a discrete signal from an analog signal 
is done by an instantaneous measurement of the analog signal amplitude at uniform 
intervals. 


Discrete vs. digital signals 


In general terms, a discrete signal is continuous in amplitude but is discrete in time. 
This means that it can have any value whatsoever for its amplitude but is defined or 
measured only at uniform time intervals. Hence, the term discrete applies to the time 
dimension and not to the amplitude. For purposes of the Fourier analysis, we assume 
that the sampling is done at uniform time intervals among the samples. 


A discrete signal is often confused with the term digital signal. Although in common 
language they are thought of as the same thing, a digital signal is a special type of 
discrete signal. Like any discrete signal, it is defined only at specific time intervals, but 
its amplitude is constrained to specific values. There are binary digital signals where the 
amplitude is limited to only two values, {+1,—1} or {0,1}. A M-level signal can take on 
just one of 2” preset amplitudes only. Hence, a digital signal is a specific type of discrete 
signal with constrained amplitudes. In this chapter, we will be discussing general discrete 
signals that include digital signals. Both of these types of signals are called discrete time 
(DT) signals. We call the time of a sampling event, the sampling instant. How fast or 
slow a signal is sampled is specified in terms of its sampling frequency, which is given in 
terms of the number of samples per second captured. 
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(a) Discrete signal, varying amplitudes 


0 5 10 15 20 25 30 
Sample, n 


0 5 10 15 20 25 30 
Sample, n 


Figure 3.1: Discrete sampling collects the actual amplitudes of the signal at the sampling instant, 
whereas digital sampling rounds the values to the nearest allowed value. In (b), the sampling 
values are limited to just 2 values, +1 or —1. Hence, each value from (a) has been rounded to 

either a +1 or —1 to create a binary digital signal. 


Generating discrete signals 


In signal processing, we often need to distinguish between a CT and a DT signal. First 
way to distinguish the two is to note that we use letter n as the index of discrete time for 
a DT signal, whereas we use letter t for the index of time for a CT signal. The second 
way is that a DT signal is written with square brackets around the time index, n, whereas 
the CT signal is written with round brackets around the time index, t. The two types, 
CT and DT, are written as follows: 


x(t) A continuous time signal 


x[n] A discrete time signal 


We can create a discrete signal by multiplying a continuous signal with a sampling 
signal, as shown in Fig. 3.2(b). This type of signal is called an impulse train and has 
a mathematical equation in terms of an infinite number of delta functions located at 
uniform intervals. This is a very special type of sampling function that is not only easy 
to visualize, but is also considered the ideal sampler. We give it a generic designation 
of p(t) for the following discussion. The sampled function, x,, is a simply the product 
of the CT signal and the sampling function, p(t). We write the sampled function as: 


x;(t) = x(t)p(t) (3.1) 
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(a) A continuous-time (CT) signal 


x[n] 


Sample number, n 


Figure 3.2: A CT signal sampled at uniform intervals T, with an ideal sampling function. The 
discrete signal in (c) x[n] consists only of the discrete samples and nothing else. The continuous 
signal is shown in dashed line for reference only. The receiver has no idea what it is. All it sees are 
the samples. 


Sampling and Interpolation 


Ideal sampling 


Let us assume we have an impulse train, p(t) with period T, as the sampling function. 
Multiplying this signal with the CT signal, as shown in Eq. (3.1), we get a continuous 
signal with nonzero samples at the sample instants, referred to as nT, or n/F,. Hence, 
the absolute time is the sample number times the time in between each sample. 


The sample time T, is an independent parameter. The inverse of the sampling time, T,, is 
called the sampling frequency, F,, given in samples per second. For a signal sampled 
with the ideal sampling function, an impulse train, the sampled signal is written per 
Eq. (3.1) as: 


p(t)= >) 6(t—nT,) 
x,(t)=x(t) 5) 6(t—nT,) (33) 


n=—oCo 


The expression for a discrete signal of a sampled version of the CT signal is written as: 
x[n] = x,(t)lr=nr, = x(nT;) (3.3) 
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The term x(nT,) with round brackets is continuous, as it is just the value of the CT signal 
at time nT,. The term x[n], however, is discrete because the index n is an integer by 
definition. The discrete signal x[n] has values only at points t = nT, where n is the 
integer sample number. It is undefined at all non-integers unlike the CT signal. The 
sampling time T, relative to the signal frequency determines how coarse or fine the 
sampling is. The discrete signal can of course be real or complex. The individual value 
x[n] is called the nth sample of the sequence. 


If we are given a CT signal of frequency fp, and this is being sampled at M samples 
per second, we would compute the discrete signal from the continuous signal with this 
Matlab code. Here, time t has been replaced with n/F,. 


xc = Sin(2«*pixf0O*t) 
Fs = 24 

n = -48: 47 

xd = sin(2*pixn/Fs) } 


BR WN 


Reconstruction of an analog signal from discrete samples 


Why sample signals? The signals are sampled for one big reason, to reduce their band- 
width. The other benefit from sampling is that signal processing on digital signals is 
“easier.” However, once sampled, processed, and transmitted, this signal must often 
then be converted back to its analog form. The process of reconstructing a signal from 
discrete samples is called interpolation. This is the same idea as plotting a function. We 
compute a few values at some selected points and then connect those points to plot the 
continuous representation of the function. The reconstruction by machines, however, is 
not as straightforward and requires giving them an algorithm that they are able to do. 
This is where the subject gets complicated. 


First, we note that there are two conditions for ideal reconstruction. One is that the 
signal must have been ideally sampled to start with, i.e., by an impulse train such that 
the sampled values represent true amplitudes of a signal. Ideal sampling is hard to 
achieve but for textbook purposes, we assume it can be done. In reality, lack of ideal 
sampling introduces distortions. 


The second is that the signal must not contain any frequencies above one-half of the 
sampling frequency. This second condition can be met by first filtering the signal by an 
antialiasing filter, a filter with a cutoff frequency that is one-half the sampling frequency 
prior to sampling. Alternatively we can assume that the sampling frequency chosen is 
large enough to encompass all the important frequencies in the signal. Let us assume 
this is also done. 
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Shape Its frequency response 
(a) 
A 
= 
'Ts 1W 
Oman e | | 
=> ! 
is Ww 
(c) ' H 
Am | => | | 
Ts W 


Figure 3.3: We can reconstruct the analog signal by replacing each sample by one of these shapes 
on the left: rectangular, triangular, or the complicated-looking sinc function. Each has a distinct 
frequency response as shown on the right. 


For the purposes of reconstruction, we chose an arbitrary pulse shape, h(t). The idea is 
that we will replace each discrete sample with this pulse shape, and we are going to do 
this by convolving the pulse shape with the sampled signal. Accordingly, the sampled 
signal x(nT,) (which is same as x[n]) convolved with an arbitrary shape, h(t), is written 
as: 
co 
x,(t) = | SS) x(nt,J6(t — nt} «h(t) (3.4) 
n=—co 

The subscript r in Eq. (3.4) indicates that this is a reconstructed signal. At each sample 
n, we convolve the sample (a single value) by h(t), a little wave of some sort, lasting 
some time. This convolution in Eq. (3.4) centers the “little wave” at the sample location. 
All these packets of waves are then arrayed and added in time. (Note that they are 
continuous in time.) Depending on the h(t) or the little wave selected, we get a recons- 
tructed signal which may or may not be a good representation of the original signal. 


Simplifying this equation by completing the convolution of h(t) with an impulse train, 
we write this somewhat simpler equation for the reconstructed signal as: 


co 
x(t)= 5) x(nT,)h(t—nT,) (3.5) 
n=—oo 

To examine the possibilities for shapes, h(t), following three options are picked; a 
rectangular pulse, a triangular pulse, and a sinc function. It turns out that these three 
pretty much cover most of what is used in practice. Each of these “shapes” has a 
distinctive frequency response as shown in Fig. 3.3. The frequency response is used 
to determine the effect these shapes will have on the reconstructed signal. Of course, 
we have not yet fully explained what a frequency response is. A frequency response is 
meant to identify or characterize physical systems. It is done by injecting an impulse into 
a system and then noting the output. This output is called the frequency response of 
the system. It is often characterized by the magnitude of the response, and the phase, 
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so it is very similar to the idea of a spectrum. In industry these two terms are used 
interchangeably. 


The sampled signals often require that we reconvert them back to their analog form. 
We discuss three main ways this is done. Intuitively speaking, the process consists of 
replacing each sample with a little wave. 


Method 1: Zero-Order-Hold 


Figure 3.3(a) shows a single square pulse. The idea is to replace each sample with 
a square pulse of amplitude equal to the sample value. This basically means that the 
sample amplitude is held to the next sampling instant in a flat line. The hold time period 
is T,. This form of reconstruction is called sample-and-hold or zero-order-hold (ZOH) 
method of signal reconstruction. Zero in ZOH is the slope of this interpolation function, 
a straight line of zero slope connecting one sample to the next. It is a simplistic method 
but if done with small enough resolution, that is a very narrow rectangle in time, ZOH 
can do a decent job of reconstructing the signal. The shape function h(t) in this case is 
a rectangle. 


h(t) = rect(t —nT,) (3.6) 


The reconstructed signal is now given using the general expression of Eq. (3.4), where 
we substitute the [rect] shape into Eq. (3.5) to get: 


co 


x(t) = ~~ x(nT, )rect(t —nT,) (3.7) 


n=— oo 


We show the index as going from —co <n < +00 as the general form. In Fig. 3.4(a), 
we see a signal reconstructed using a ZOH circuit, in which the rectangular pulse is 
scaled and repeated at each sample. 


Method 2: First-Order-Hold (linear interpolation) 


Zero-order hold gives us a stair-step like signal. Now, instead of a square pulse, we 
replace each sample with a triangle of width 2T, as given by the expression 


1-t/T, 0<t<T, 
h(t)=41+t/T, T,<t<2T, (3.8) 


0 else 
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(a) Signal and the samples 


x(nT,) 


(b) Replacing each sample with a rectangle 


x(t) 


Time, nT, 


Figure 3.4: A zero-order-hold: hold each sample value to the next sample time. 


x(nT, ) 


x[n] 


Time, nT, 


Figure 3.5: A First-order-hold (FOH): replace each sample with a triangle of twice the time-width. 


This function is shaped like a triangle and the reconstructed signal equation from Eq. (3.5) 
now becomes 


co 


ci= >. x(nT,) tri") (3.9) 


n=—co s 


Figure 3.5(b) shows that instead of nonoverlapping rectangles as in ZOH, we use over- 
lapping triangles. This is because the width of the triangle is set to twice the sample 
time. This double-width does two things: it keeps the amplitude the same as the case 
of the rectangle and it fills the in-between points in a linear fashion. This method is 
also called a linear interpolation as we are just connecting the points. This is also 
called the First-order-hold (FOH) because we are connecting the adjacent samples 
with a line of linear slope. Why you may ask use triangles when we can just connect 
the samples? The answer to this query is that machines cannot “see” the samples nor 
“connect” the samples. Addition is about all they can do well. Hence, this method 
replaces the linear interpolation as you and I might do, visually with a simple addition 
of displaced triangles. It also gives us a hint as to how we can use any shape we want 
and in fact of any length, not just two times the sample time! Sinc pulse is such a shape. 
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Method 3: Sinc interpolation 


We used triangles in FOH and that seems to produce a better-looking reconstructed 
signal than ZOH. We can, in fact use just about any shape we want to represent a sample, 
from the rectangle to one composed of a complex shape, such as a sinc function. A sinc 
function seems like an unlikely choice as it is noncausal (as it extends into the future) 
but it is infact an extension of the idea of the first two methods. Both ZOH and FOH are 
forms of polynomial curve fit. The FOH is a linear polynomial, and we continue in this 
fashion with second-order on up to infinite orders to represent just about any type of 
wiggly shape we can think of. A sinc function, an infinite order polynomial, is the basis 
of perfect reconstruction. The reconstructed signal becomes a sum of scaled, shifted sinc 
functions same as was done with triangular shapes. Even though the sinc function is an 
infinitely long function, it is zero-valued at regular intervals. This interval is equal to 
the sampling period. As each sinc pulse lobe crosses zero at only the sampling instants, 
the summed signal where each sinc is centered at a different time, adds no interference 
(quantity of its own amplitude) to other sinc pulses centered at other times. Hence, this 
shape is considered to be free of inter-symbol interference (ISI). 


The equation obtained for the reconstructed signal in this case is similar to the first two 
cases, with the reconstructed signal summed with each sinc located at nT,. 


h(t) = sine(t — nT,) 
co 
(3.10) 
x,(t) = > x(nT,) sine(t —nT,) 
n=—0o 

Figure 3.6 shows the sinc reconstruction process for a signal with each sample being 

replaced by a sinc function and the resulting reconstructed signal compared to the 

original signal in Fig. 3.6(b). 


Clearly the sinc construction in Fig. 3.6(c) does a very good job. How to tell which of 
these three methods is better? The ZOH is kind of rough. But to properly assess these 
methods, we require a full understanding of the Fourier transform, a topic that will be 
covered in Chapter 4. Therefore, we will drop this subject now with recognition that a 
signal can be reconstructed using the linear superposition principal using many different 
shapes, with sinc function being one example, albeit a really good one, the one we call 
the “perfect reconstruction.” 


Sinc function detour 


We will be coming across the sinc function a lot. It is not only the most versatile, 
but also most used piece of mathematical concept in signal processing. Hence, we 
examine the sinc function in a bit more detail here. In Fig. 3.7, the function is plotted 
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ie (a) Spupies 


Sinc is zero at all 
zero crossings ~ 


Sunis to zero at all sample 


points 


Time, nxT, 


Figure 3.6: Sinc reconstruction: replace each sample with a sinc pulse 


in time-domain. This form is called the normalized sinc function. The sinc function is a 
continuous function of time, t, and is not periodic. It is that nice-looking single-peak 
signal that oscillates and eventually damps out. 


1 t=0 
sin(zt) t # 0 
Tt 
At t = 0, its value is 1.0. As seen in Eq. (3.11), the function is zero for all integer values 
of t, because sine of an integer multiple of 7 is zero. In Matlab, this function is given 
as sinc(t). No 7 is needed as it is already programmed in. The Matlab plot would yield 
first zero crossing at +1 and as such the width of the main lobe is 2 units. By inserting 
a variable T, into equation Eq. (3.12), any main lobe width can be created. The generic 
sinc function of lobe width T, (main lobe width = 2T, ) is given by 
sin(zt/T,) 


1 % A sinc function in two forms 
t = -6: .01: 6; 

Ts = 23 

h = sinc(t/Ts); 

habs = abs (hl) 

plot(t, h, t, habs) 


Dn un Bw DN 
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; (a) Normalized Sinc function in time-domain 


sinc(t) 


8 -7 -6 -5 -4-3 -2-1 0 1 2 3 4 5 6 7 8 


(b) Normalized Sinc function, absolute value 


> 


Figure 3.7: The sinc function in time-domain. 
The signal is nonperiodic. Its peak value is 1 for the normalized form. The main lobe of the 
function spans two times the parameter T,. In (b) the absolute values are shown so the lobes on 
the negative side are flipped up. 


In Matlab, we would create a sinc function as in the code above. 


Figure 3.7 shows this function for two different values of, T, = 2 and T, = 1 (same as 
the normalized case). The sinc function is often plotted in the second style, Fig. 3.7(b) 
with amplitudes shown as absolute values. This style makes it easy to see the lobes and 
the zero crossings. Note that zero-crossings occur every T, seconds. Furthermore the 
function has a main lobe that is 2 times T, seconds wide. All the other lobes are T, 
seconds wide. 


The sinc function has some interesting and useful properties. The first one is that the 
area under it is equal to 1.0. 


co 
[ sinc(27t/T,) dt = rect(0O) = 1. (3.13) 
—oo 

The second interesting and useful property, from Eq. (3.12) is that as T, decreases, the 
sinc function approaches an impulse. This is seen in Fig. 3.7. A smaller value of T, 
means a narrower lobes. Narrow main lobe makes the central part impulse-like and 
hence it is noted that as T, — O goes to zero, the function approaches an impulse. 
Another interesting property is that the sinc function is equivalent to the summation 
of all complex exponentials. This is a magical property in that it tells us how Fourier 
transform works by scaling these exponentials. We have shown this effect in Chapter 1 
by adding many harmonics together and noting that the result approaches an impulse 
train. 


ie ae 
sine) = 3 | e?® dw (3.14) 


—T 
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This property is best seen in Fig. 3.8, which shows the result of an addition of a large 
number of harmonic complex exponentials together. The signal looks very much like an 


impulse train. 


Summation of 90 consecutive harmonics 


gi 
z 
E 
ee | 
0) 2 4 6 8 10 
Time, t 


Figure 3.8: The addition of 90 consecutive harmonics (f = 1, 2,...90), result in very nearly an 
impulse train. 


The sinc function is also the frequency response to a square pulse. It can be said that 
it is a representation of a square pulse in the frequency domain. If a square pulse (also 
called a rectangle, probably a better name anyway) is taken in time domain, then its 
Fourier series representation will be a sinc, alternately, the sinc function has a frequency 
representation of a rectangle, which says that it is absolutely bounded in bandwidth. We 
learn from this that a square pulse in time domain has very large (or in fact infinite) 
bandwidth and is not a desirable pulse type to transmit. 


Sampling rate 


How do we determine an appropriate sampling rate for an analog signal? Figure 3.9 
shows an analog signal sampled at two different rates; the signal is sampled slowly and 
sampled rapidly. At this point, our idea of slow and rapid is arbitrary. 


(a) Slow sampling (b) Faster sampling 


Amplitude 


Time 


Figure 3.9: The sampling rate is an important parameter, (a) analog signal sampled probably too 
slowly, (b) probably too fast. 


It is obvious by looking at the samples in Fig. 3.9(a) that the rate is not quick enough 
to capture all the ups and downs of the signal. Some high and low points have been 
missed. However the rate in Fig. 3.9(b) looks like it might be too fast as it is capturing 
more samples than we may need. Can we get by with a smaller rate? Is there an 
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optimum sampling rate that captures just enough information such that the sampled 
analog signal can still be reconstructed faithfully from the discrete samples? 


Shannon’s Theorem 


There is an optimum sampling rate. This optimum sampling rate was established by 
Harry Nyquist and Claude Shannon and others before them. However the theorem 
has come to be attributed to Shannon and is thus called the Shannon’s theorem. 
Although Shannon is often given credit for this theorem, it has a long history. Even 
before Shannon, Harry Nyquist (a Swedish scientist who immigrated to USA in 1907 
and did all his famous work in the USA) had already established the Nyquist rate. 
Shannon took it further and applied the idea to reconstruction of discrete signals. And 
even before Nyquist, the sampling theorem was used and specified in its present form 
by a Russian scientist V A. Kotelnikov in 1933. In fact even he may have not been the 
first. So simple and yet so profound, the theorem is a very important concept for all 
types of signal processing. 


The theorem says: 


For any analog signal containing among its frequency content a maximum frequency of 
fmax» then the analog signal can be represented faithfully by N equally spaced samples, 
provided the sampling rate is at least two times fmax samples per second. 


We define the Sampling frequency F,, as the number of samples collected per second. 
For a faithful representation of an analog signal, the sampling rate F, must be equal 
or greater than two times the maximum frequency contained in the analog signal. We 


The Nyquist rate is defined as the case of sampling frequency F, exactly equal to two 
times fimax- This is also called the Nyquist threshold or Nyquist frequency. T, is defined 


write this rule as 


as the time period between the samples, and is the inverse of the sampling frequency, 
F 


S 
A real life-signal will have many frequencies. In setting up the Fourier series representa- 
tion, we defined the lowest of all its frequencies, fo, as its fundamental frequency. The 
fundamental period of the signal, Tp, is the inverse of the fundamental frequency as 
defined in chapter 1. 


The maximum frequency, fim ,, contained within the signal is used to determine an 
appropriate sampling frequency for the signal, F,. An important thing to note is that 
the fundamental frequency, fp, is not related to the maximum frequency of the signal. 
Hence, there is no relationship whatsoever between the fundamental frequency, fo, of 
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Figure 3.10: There is no relationship between the sampling period and the fundamental period of 
the signal. They are independent quantities. 


the analog signal, the maximum frequency, f,,,,, and the sampling frequency, F,, picked 
to create a discrete signal from the analog signal. The same is true for the fundamental 
period, Tp, of the analog signal and the sampling period T,. They are not related either. 
This point can be confusing. Tp is a property of the signal, whereas T, is something 
chosen externally for sampling purposes. The maximum frequency similarly indicates 
the bandwidth of the signal, that is f,.4,—fo- 


The Shannon theorem applies, strictly speaking, only to baseband signals or the low-pass 
signals. There is a complex-envelope version where even though the center frequency 
of a signal is high due to having been modulated and up-converted to a higher carrier 
frequency, the signal can still be sampled at twice its bandwidth and be perfectly recons- 
tructed. This is called the band-pass sampling theorem. This will not be taken up in this 
book. 


Aliasing of discrete signals 


Figure 3.11(a) shows discrete samples of a signal whereas Fig. 3.11(b) shows that these 
points fit several waves shown. So which wave did they really come from? 


; (a) Collected samples 


x[n] 


x(t) 


Figure 3.11: Three signals of frequency 1, 3 and 5 Hz all pass through the same discrete samples 
shown in (a). How can we tell which frequency was transmitted? 
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The samples in Fig. 3.11(a) could have, in fact, come from an infinite number of other 
waves which are not shown. This is a troubling property of discrete signals. This effect, 
that many different frequencies can be mapped to the same samples, is called alias- 
ing. This effect, caused by improper sampling of the analog signal, leads to erroneous 
conclusions about the signal. Later, we will discuss how the spectrum of a discrete signal 
repeats, and it repeats precisely for this reason that we do not know the real frequency 
of the signal. Its a way of the math telling us that it does not know the real answer 
among many seemingly correct solutions. 


Bad sampling 


If a sinusoidal signal of frequency fy (because a sine wave only has one frequency, both 
its highest and its lowest frequencies are the same) is sampled at less than two times the 
maximum frequency, F, < 2f, then the signal that is reconstructed, although passing 
through all the samples, is erroneously mapped to a wrong frequency. This wrong 
frequency, an alias, is not the one that we started with. Given a sampling frequency, 
we can identify all possible alias frequencies by this expression. 


y(t) =sin(272(fo — mF,)t) (3.16) 


Here, m is a positive integer satisfying this equation 
F 
|fo—mP,| < > (3.17) 


These two equations are very important but they are not intuitive. So let us take a look 
at an example. 


Example 3.1. Take the signal with fp = 5 Hz and F, = 8 Hz or 8 samples per second or 
samps. We use Eq. (3.16) to find the possible alias frequencies. Here are first three for 
(m = 1,2,3,...) aliases. 


m=1: y(t)=sin(272(5 —1 x 8)t) = sin(2773t) 
m=2: y(t) =sin(27(5 —2 x 8)t) = sin(2711t) 
m=3: y(t) =sin(27(5 —3 x 8)t) = sin(27719t) 


The first three alias frequencies computed are 3, 11, and 19 Hz, all varying by 8 Hz, the 
sampling frequency. The samples fit all of these frequencies. The significance of m, the 
order of the aliases is as follows. When the signal is reconstructed, we need to filter it 
by an antialiasing filter to remove all higher frequency aliases. Setting m = 1 implies 
the filter is set at frequency of F,/2 or in this case 4 Hz, as per the limitation set on index 
m by Eq. (3.17). Therefore, we only see alias frequencies that are below this number. 
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Higher order aliases although present are not seen. In computing the possible set of 
alias frequencies, the value of m is limited by Eq. (3.17). 


Figure 3.12 shows the Eq. (3.16) in action. Each m in this expression represents a shift. 
For m = 1, the cutoff point is 4 Hz, which only lets one see the 3 Hz alias frequency but 
not 11 Hz or higher. 


(«, MOMNEL 2. us Mind alias 02 Be 


Ast Alias, 3. and'13 He | 


4 


Frequency, Hz 


Figure 3.12: The spectrum of the signal repeats with sampling frequency of 8-Hz. Only the 3-Hz 
signal is below the 4-Hz cutoff. Note that each pair has the same distance between the pulses, but 
each pair is displaced from the other pair by the sampling frequency. 


The fundamental pair of components (the real signal before reconstruction) are at +5 
and —5 Hz. Now from Eq. (3.16), this spectrum (the bold pair of impulses at £5 Hz) 
repeats with a sampling frequency of 8 Hz. Hence, the pair centered at 0 Hz is also 
centered at 8 Hz (dashed lines). The lower component falls at 8— 5 = 3 Hz and the 
upper one at 8+ 5 = 13 Hz. The second shift centers the components at 16 Hz, with 
lower component at 16 —5 = 11 Hz and the higher at 16+ 5 = 21 Hz. The same thing 
happens on the negative side. All of these are called alias pairs. They are all there unless 
the signal is filtered to remove these. However, the limit on what we can see is placed 
by the sampling frequency and Eq. (3.17). A system of sampling frequency of 8 Hz will 
allow us to detect only the one incorrect alias of 3 Hz as shown in highlighted part of 
Fig. 3.19. 


Good sampling 


The sampling theorem states that you must sample a signal at twice or higher times its 
maximum frequency to properly reconstruct it from its samples. The consequence of 
not doing this is we get aliases (from Eq. (3.16)) at wrong frequencies. But what if we 
do sample at twice or greater rate. Does that have an effect and what is it? 


Example 3.2. 
x(t) = 0.2sin(27t) + sin(4zt) + 0.7 cos(6zt) + 0.4cos(8zt) 


Let us take this signal as shown in Fig. 3.13(a). The signal has four frequencies, which 
are 1, 2,3 and 4 Hz. The highest frequency is 4 Hz. We sample this signal at 20 Hz and 
also at 10 Hz. Both of these frequency choices are above the Nyquist rate, so that is good. 
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The spectrum as computed by the FSC of the four frequencies in this signal is shown in 
Fig. 3.13(b). (We have not yet discussed how to compute this discrete spectrum and 
will do so soon, but the idea is the same as for the CT case.) 


A very important fact for discrete signals is that the FSC repeat with integer multiple of 
the sampling frequency F,. The entire spectrum is copied and shifted to a new center 
frequency to create an alias spectrum. This theoretically continues forever on both sides 
of the principal alias, shown in a dashed box in the center in Fig. 3.14. The spectrum 
centered at the zero frequency is called the Principal alias. 


The DT version of the CT signal is given by setting CT time t to n/F, in the following 
expression. Here n is the sample number and F,, the sampling frequency. 


x(t) = 0.2sin(27 7) + sin(47 7) + 0.7 cos(67 7) + 0.4 cos(87 7) 
Figure 3.13 shows the signal sampled at 20 Hz, and we see that there is plenty of 


(a) Signal sampled at Fs = 20 samps 


g 


ad ih YY be rr ye Moe Pape ‘a im af Ty I 


10 20 30 40 50 60 70 80 
Sample, n 


(b) Spectrum copies repeat every 20 Hz 


-40 =—20: 0 20 40 


Figure 3.13: (a) A composite signal of several sinusoid is sampled at twice the highest frequency. 
(b), the discrete coefficients repeating with the sampling frequency, F, = 20 Hz. 


] Signal sampled at Fs = 10 samps 


Figure 3.14: The signal sampled at F, = 10 in (a), results in much closer replications in (b). 
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distance between the copies. This is because the bandwidth of the signal is only 8 Hz, 
hence, there is 12 Hz between the copies. Figure 3.14(b) shows the spectrum for the 
signal when sampled at 10 Hz. The spectrum is 8 Hz wide but now the spectrum are 
close together with only 2 Hz between the copies. 


Decreasing the sampling rate decreases the spacing between the alias spectrum. The 
copies would start to overlap if they are not spaced at least two times the highest 
frequency of the signal. In such a case, separation of one spectrum from another becomes 
impossible. When nonlinearities are present, the sampling rate must be higher than 
Nyquist threshold to allow the spectrum to spread but not overlap. The same is true for 
the effect of the roll-off from the antialiasing filter. As practical filters do not have sharp 
cutoffs, some guard band has to be allowed. This guard band needs to be taken into 
account when choosing a sampling frequency. 


If the spectrum do overlap, the effect cannot be gotten rid of by filtering. As we do not 
have knowledge of the signal spectrum, we are not likely to be aware of any aliasing 
if it happens. We always hope that we have correctly guessed the highest frequency in 
the signal and hence have picked a reasonably large sampling frequency to avoid this 
problem. 


However, often we do have a pretty good idea about the target signal frequencies. We 
allow for uncertainties by sampling at a rate that is higher than twice the maximum 
frequency, and usually much higher than twice this rate. For example, take audio signals 
that range in frequency from 20 to 20,000 Hz. When recording these signals, they 
are typically sampled at 44.1 kHz (CD), 48 kHz (professional audio), 88.2 kHz, or 96 
kHz rates depending on quality desired. Signals subject to nonlinear effects spread in 
bandwidth after transmission and require sampling rates of 4 to 16 times the highest 
frequency to cover the spreading of the signal. 


Discrete Signal Parameters 


There are important differences between discrete and analog signals. An analog signal 
is defined by parameters of frequency and time. To retain this analogy of time and 
frequency for discrete signals, we use n, the sample number as the unit of discrete time. 
The frequency however, gives us a problem. If in DT, time has units of sample, then the 
frequency of a discrete signal must have units of radians per sample. 


The frequency of a discrete signal is indeed a different type of frequency than the 
traditional frequency of continuous signals. It is given a special name of its own, digital 
frequency and we use the symbol 2 to designate it. We can show the similarity of this 
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frequency to an analog frequency by noting first how these two forms of signals are 
written. 
Analog signal: x(t) = sin(27fot) 


: : ‘ (3.18) 
Discrete signal: x[n] = sin(27fonT,) 


The first expression is a continuous signal and the second a discrete signal. For the 
discrete signal, replace CT, t, with nT,. Alternately, write the discrete signal, as in 
Eq. (3.19) by noting that the sampling time is inverse of the sampling frequency. (We 
always have the issue of sampling frequency even if the signal is naturally discrete and 
was never sampled from a continuous signal. In such a case, the sampling frequency is 
just the inverse of time between the samples.) 


x[n] = sin( 22n), (3.19) 


Ss 


Digital frequency, only for discrete signals 


We define the Digital frequency, Q by this expression. 


= 21fo 
- «#F 


Ss 


Q (3.20) 
Substitute this definition of digital frequency into Eq. (3.19) to obtain an expression for 
a sampled sinusoid in discrete time. 


x[n] = sin(Qn) (3.21) 
Here are two analogous expressions for a sinusoid, a discrete and a continuous form. 


Analog signal : x(t) = sin(wt 
g sig (t) (wt) aon 
Discrete signal : x[n] = sin(Qn) 


The digital frequency 2 is equivalent in concept to an analog frequency, but these two 
“frequencies” have different units. The analog frequency has units of radians per sec- 
ond, whereas the digital frequency has units of radians per sample. 


The fundamental period of a discrete signal is defined as a certain number of samples, 
No. This is equivalent in concept to the fundamental period of an analog signal, Tp, given 
in real time. To be considered periodic, a discrete signal must repeat after No samples. 
In the continuous domain, a period represents 27 radians. To retain equivalence in 
both domains, Nj samples hence must also cover 27 radians, from which we have this 
relationship. 

QoNo = 27 (3.23) 
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The units of the fundamental digital frequency Q, are radians/sample and units of No 
are just samples. The digital frequency is a measure of the number of radians the signal 
moves per sample. Furthermore, when it is multiplied by the fundamental period No, 
an integer multiple of 27 is obtained. Hence, a periodic discrete signal repeats with a 
frequency of 271, which is the same condition as for an analog signal. The only difference 
being that analog frequency is defined in terms of time it takes to cover 27 radians and 
digital frequency in terms of samples needed to cover the same. 


(a) The continuous signal 


x(t) 


x[n] 


; Sample, n 
One period 


Digital frequency, Radians 

Figure 3.15: A discrete signal in time domain can be referred by its sample numbers, n (1 to N) or 

by the digital frequency phase advance. Each sample advances the phase by 2 /N radians. In this 
example, N is 8. In (a), the x-axis is in terms of real time. In (b) the x-axis is in terms of sample 
identification number or n. In (c) we note the radians that pass between each sample such that 


total excursion over one period is 27. 


There are three ways to specify a sampled signal. In Figure 3.15(a), two periods of 
a signal are shown. This is a continuous signal; hence, the x-axis is in continuous 
time, t. Now, we sample this signal. Each cycle is sampled with eight samples, with 
a total of 17 samples are shown, numbered from —8 to +8 in Fig. 3.15(b). This is 
the discrete representation of signal x(t) in terms of samples that are identified by the 
sample number, n. This is one way of showing a discrete signal. Each sample has a 
sample number to identify it. 


The sample number can be replaced with a instantaneous phase value for an alternate 
way of showing the discrete signal. Figure 3.15(c) shows that there are 8 samples over 
each 27 radians or equivalently a discrete frequency of 27/8 radians per sample. This 
is the digital frequency, Q,9 which is pushing the signal forward by these many radians. 
Each sample moves the signal further in phase by 7/4 radians from the previous sample, 
with two cycles or 16 samples covering 47 radians. Hence, we can label the samples in 
radians. Both forms, using n or the phase are equivalent but the last form (using the 
phase) is more common for discrete signals, particularly in text books, however, it tends 
to be non-intuitive and confusing. 
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Periodicity of discrete signals 


Fourier series representation requires a signal to be periodic. Therefore, can we assume 
that a discrete signal, if it is sampled from a periodic signal, is also periodic? The answer 
is strangely enough, no. Here, we look at the conditions of periodicity for a continuous 
and a discrete signal. 


Continuous signal: x(t)=x(t+T) 
. . (3.24) 
Discrete signal: x[n]=x[n+N] 


This expression says that if the values of a signal repeat after a certain number of 
samples, N, for the discrete case and a certain period of time, T, for the continuous 
case, then the signal is periodic. The smallest value of N that satisfies this condition is 
called the fundamental period of the discrete signal. As we use sinusoids as basis functions 
for the Fourier analysis, let us apply this general condition to a sinusoid. To be periodic, 
a discrete sinusoid that is defined in terms of the digital frequency and time sample, n, 
must repeat after N samples, hence, it must meet this condition. 


cos(Qgn) = cos (Qo(n + N)) (3.25) 
We expand the right-hand-side of Eq. 3.25 using this trigonometric identity: 
cos(A + B) = cos(A) cos(B) — sin(A) sin(B) (3.26) 
To examine under which condition this expression is true. we set: 
cos (Qo(n + N)) = cos(Qon) cos(Q_N) — sin(N_n) sin(Q oN). (3.27) 


For Eq. (3.25) to be true, we need the underlined terms on the RHS to be equal to 1 and 
O respectively. 


cos(Q9n) = cos(Qpn) cos(N_N ) —sin(Np97n) sin(A.N) (3.28) 
eS SS eS S 
=1 =0 


For these two conditions to be true, we must have 


QgN = 27k or 
Qo k 
= 3.2 
on N (3.29) 


It is concluded that a discrete sinusoid is periodic if and only if its digital frequency is a 
rational multiple of 27 based on the smallest period N. This implies that discrete signals 
are neither periodic for all values of Qo, nor for all values of N. For example, if Q) = 1, 
then no integer value of N or k can be found to make the signal periodic per Eq. (3.29). 
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We write the expression for the fundamental period of a discrete and periodic signal as: 


_ 2k 


N= 
Qo 


(3.30) 


The smallest integer k, resulting in an integer N, gives the fundamental period of the 
periodic sinusoid, if it exists. Hence, for k = 1, we get N = Np. 


Example 3.3. What is the digital frequency of this signal? What is its fundamental 
period? 


27 T 
x[n] = cos (n+ 4 
5 3 


The digital frequency of this signal is 277/5 because that is the coefficient of time index 


Sample, n 


Figure 3.16: Signal of Ex. 3.3. 


n. The fundamental period Nog is equal to 5 samples that we find using Eq. (3.30) setting 
k=1. 
2m 2m 

Qo 27/5 


0 


Example 3.4. What is the period of this discrete signal? Is it periodic? 


_ (3 T 
x[n]= sin( En + | 
4 4 


Sample, n 


Figure 3.17: Signal of Ex. 3.4. The period of this signal is 8 samples. 


The digital frequency of this signal is 3/4. The fundamental period is equal to 


2k  2n(k=3) 
% 32/4 


No= = 8 samples 
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The period is 8 samples but it takes 67 radians to get the same sample values again. As 
we see, the signal covers three cycles in 8 samples. As long as we get an integer number 
of samples in any integer multiple of 271, the signal is considered periodic. 


Example 3.5. Is this discrete signal periodic? 
x[n]= sin (an + | 


The digital frequency of this signal is 1/2. Its period from Eq. (3.30) is equal to 


27k 
N = —— =4nrk 
OQ 
As k must be an integer, this number will always be irrational; hence, it will never result 
in repeating samples. The continuous signal is, of course, periodic but as we can see 
in Fig. 3.18, there is no periodicity in the discrete samples. They are all over the place, 


with no regularity. 


Sample, n 


Figure 3.18: Signal of Ex. 3.5 that never achieves an integer number of samples in any integer 
multiple of 21. 


Discrete Complex Exponentials as Basis of DT Fourier Series 


The CT Fourier series (CTFS) is written in terms of trigonometric functions or complex 
exponentials. Because these functions are harmonic and hence orthogonal to each 
other, both trigonometric and complex exponentials form a basis set for complex Fourier 
analysis. The coefficients can be thought of as scaling of the basis functions. We are 
now going to look at the Fourier series representation for DT signals using DT complex 
exponentials as the basis functions. 


A discrete complex exponential is written by replacing t in CT domain with n, and w 
with the digital frequency ©. Now, we have these two forms of the CE just as we wrote 
the two forms of the sinusoid in Eq. (3.22). 


Continuous form of a CE: e/@0° 


Discrete form of a CE: e/%o” 
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The discrete form of the fundamental is expanded as follows. We show a single CE of 
2m 
N 


yet been included in this equation. 


digital frequency = for variable n, the DT index of time. The harmonic factor k has not 


ein — pi %)n (3.31) 


Harmonics of a discrete fundamental CE 


For an analog signal, we define its harmonics by multiplying its frequency directly by 
a multiplier k. Can we do the same for discrete signals? Do we just multiply the 
fundamental frequency by the index k, such as 2kz/N for all k? Well, no. If a signal 
has fundamental digital frequency of 77/5, then is frequency 27/5 the next harmonic? 
Yes, and no, because this method leads us into problems. 


The range of the digital frequency is 27. To obtain its next harmonic, we increment 
its frequency by adding an integer multiple of 27 to it. Hence, the frequency of a kth 
harmonic of a discrete signal is (Q9 + 27k) or (1/5 +22) = 1177/5 for k = 1. This is 
a very important point. The analog and discrete harmonics have equivalent definitions 
for purposes of the Fourier analysis. We will see, however, that they do not display the 
same behavior. We cannot use these traditionally defined discrete harmonics for the 
Fourier analysis. 


Discrete fundamental: e/(27/N)n 


Discrete harmonic: e/(2@7/N+27k)n 


Repeating harmonics of a discrete signal 


Where each and every harmonic of an analog signal looks different, i.e., has higher 
frequency, shows more ups and downs, etc., the discrete harmonics defined by e/@"/N+274)n 
for each k are not distinct from each other. They are said to be non-distinct for each 


harmonic index, k. This is easy to see from this proof. 


,[n] = ej (2n/N+2nk)n 
— eik(2n/N)n j(2nkn) (3.32) 
ee 
=1 

Note that the second part can be written as in Eq. (3.33) and is equal to 1.0 because the 

cosine wave at any integer 2k7 radians is always 1 and the sine for the same is always 
0. 

elkrn) — eos(2knt)_, + jsin(2kn7)=9 = 1 (3.33) 
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Each increment of the harmonic by 27tk causes the harmonic factor to cancel and result is 
we get right back to the fundamental! Hence this method of getting at distinct harmonics 
is for naught! 


Example 3.6. Show the first two harmonics of an exponential of frequency 77/6 if it is 
being sampled with a sampling period of 0.25 s. 


The discrete frequency of this signal is 7/6. For an exponential given by e~/@o! 
replace wg, with 77/6 and t with n/4. (T, = 0.25 hence, F, = 4) We write this discrete 


signal as: 


, we 


«27 
x(n] =e" 
Let us plot this signal along with its next two harmonics, which are: 


Fundamental : e~/ ( in 


Harmonic 1: oH 42k=De)n = oil B+20)n (3.34) 


Harmonic 2: oil H+2k=2)1)n = oil B+4n)n 


We plot all three of these in Fig. 3.19. Why is there only one plot in this figure? Simply 
because the three signals from Eq. (3.34) are identical and indistinguishable. 


(a) Real part of eilr/24)n eila/4 ra eila/24 4a)0 


30 20 10 0 10 20 30 
e ila/24)n —j(n/2442n)n —j(n/244+40)n 
? 


e ,€ 


Sample, n 


Figure 3.19: Signal of Example 3.6 the imaginary part is a sine wave, (b) the real part, which is of 
course a cosine. The picture is same for all integer values of k. 


This example demonstrates that for a discrete signal the concept of harmonic frequencies 
does not lead to meaningful harmonics. All harmonics are the same. But then how can 
we do Fourier series analysis on a discrete signal if all basis signals are identical? So far 
we only looked at discrete signals that differ by a phase of 27. Although the harmonics 
obtained this way are harmonic in a mathematical sense, they are pretty much useless 
in the practical sense, being non-distinct. So where are the distinct harmonics that we 
can use for Fourier analysis? 
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The secret hiding place of the discrete harmonics is inside the 27 range, N unique 
harmonics, perfectly suitable for Fourier analysis. These N sub-frequencies are indeed 
distinct. But there are only N of them, with N being the fundamental period in number 
of samples. 


Given a discrete signal of period N, the signal has N unique harmonics. Each such 
harmonic frequency is given by 


on] = k=En fork =0,1,...,N—1. (3.35) 


Increasing k beyond N — 1 will give the same harmonic as for k = 0 again. This is of 
course equivalent to a full 27 radian phase traversal. Hence discrete harmonics are 
obtained not by an increment of 27 but by the digital frequency itself, which is a small 
portion of 27. 


Example 3.7. Let us check this idea as digital frequency of a signal is varied just within 
the 0 to 27 range instead of as integer increment of 27. Take this signal: 


.2 
x[n] =e" 


Its digital frequency is 27/6 and its period is equal to 6 samples. We now know that 
the signals of digital frequencies 27/6 and 1471/6 ( which is 27 /6+27) are exactly the 
same. So, the digital frequency is increased, not by 27 but instead in six steps, each time 
increasing by 27/6 so that after six steps, the total increase will be 27 as we go from 
27/6 to 1477/6. We do not jump from 27/6 to 1472/6 but instead move in between. 
We can start with zero frequency or from 27/6 or 27 as it makes no difference where 
you start. Starting with Oth harmonic, if we move in six steps, we get these six unique 
signals. 


by = 2n(k = 0)/6 =0 


ob, =2n(k =1)/6=27/6 
by = 2n(k = 2)/6 =4n/6 


bs = 2n(k =5)/6 =102/6 


The variable k, steps from 0 to K—1, where K is used as the total number of harmonics. 
Index n remains the index of the sample or time. Note that since the signal is periodic 
with No samples, K is equal to No. 


The process can be visualized as shown in Fig. 3.20 for N = 6. This is our not-so-secret 
set of N harmonics (within any 27 range) that are unique and used as the basis set for 
discrete Fourier analysis. 
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Figure 3.20: Discrete harmonic frequencies in the range of 2mm to 2m(m + 1). 


Figure 3.21 plots these discrete complex exponentials so we can examine them. There 
are two columns in this figure, with left containing the real and right the imaginary 
part, together representing the complex-exponential harmonic. The analog harmonics 
are shown in dashed lines for elucidation. The discrete frequency appears to increase 
(more oscillations) at first but then after three increments (half of the period, N) starts 
to back down again. Reaching the next harmonic at 27, the discrete signal is back to 
where it started. Further increases repeat the same cycle. 


Let us take a closer look. The first row in Fig. 3.31 shows a zero-frequency harmonic. All 
real samples are 1.0, since this is a cosine. In (b), the continuous signal is of frequency 
1 Hz, the discrete samples come from cos(271/6). In (c), we see a continuous signal of 
2 Hz and discrete samples from cos(27:/3). It is seen that by changing the phase from 
(a) to (g) we have gone through a complete 27 cycle. In (g) the samples are identical 
to case (a) yet, continuous frequency is much higher. The samples for case (g) look 
exactly the same as for case (a) and case (h) looks exactly the same as case (b) and so 
on. These intermediate 6 harmonic in a 27 range are distinct where those obtained by 
increasing the frequency by 27 are not! 


These harmonics are an orthogonal basis set and can be used to create a Fourier series 
representation of a discrete signal. The weighted sum of these N special signals forms 
the discrete Fourier series (DFS) representation of the signal. Unlike the CT signal, here 
the meaningful range of the harmonic signal is limited to a finite number of harmonics, 
which is equal to the period of the discrete signal in samples. Hence, the number of 
unique coefficients is finite and equal to the period N. 


Discrete-Time Fourier Series Representation 


The Discrete-time Fourier series (DTFS) is the discrete representation of a DT periodic 
signal by a linear weighted combination of these Ky distinct complex exponentials. 
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Real part Imag. part 


7rUy Ui 
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Figure 3.21: The real and the imaginary component of the discrete signal harmonics. They are all 
different. 
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These distinct orthogonal exponentials exist within just one cycle of the signal with 
cycle defined as a 27 phase shift. As the number of harmonics available is discrete, 
the spectrum is also discrete, just as it is for a continuous signal. We write the Fourier 
representation of the discrete signal x[n] as the weighted sum of these harmonics. 


1 een 
x[n] = rn DS Ce!* io (3.36) 


Equation (3.36) is the Fourier series representation of a discrete periodic signal. C;, are 
the complex Fourier series coefficients (FSC), which we discussed in Chapter 2. There 
are k harmonics, hence you see the coefficients with index k. In the exponent to the CE, 


the term 22 is incremental frequency change, or the fundamental digital frequency of 


No 
the signal. Term k increments this fundamental frequency, with n is the index of time 


for the DT signal. 


The DTFS coefficients of the kth harmonic are exactly the same as the coefficient for a 
harmonic that is an integer multiple of Ny samples so that: 


Ck = Cyrmno 


The Inverse DTFSC equation is given by the kth coefficient and hence, the kth coefficient 
is given by 


No-1 


C.=— 3 x[nJeionk (3.37) 
n=0 


The (k + mK )th coefficient is given by 


No-1 
Ces, Daimler 
0 n=0 
No-1 
x[n] 
n=0 


ey Sb eFk Mon p—ImNoMn 
No 


The second part of the signal is equal to 1. 


e JMNoNon _ e Jm2nn =] 
(Because the value of the complex exponential at integer multiples of 27 is equal to 


1.0). Therefore, we have: 


No-1 


1 
— > x[nJe J tmKo}Mon — Cy (3.38) 


Cr+mNo foal N, 
0 n=0 
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This says that the harmonics repeat, and hence the coefficients also repeat. The spectrum 
of the discrete signal (comprising the coefficients) keeps repeating after every integer 
multiple of the Ky samples, or by the sampling frequency. In practical sense, this means 
we can limit the computation to just the first Ky harmonics, where, Ky is equal to No. 


This is a very different situation from the continuous signals, which do not have such 
behavior. The CT coefficients are unique for all values of k. 


DTFS Examples 


Example 3.8. Find the DT Fourier series coefficients of this signal. 
2 
x[k]=1+ sin( =} 
10 


The fundamental period of this signal is equal to 10 samples from observation. Hence, 
it can only have at most 10 unique coefficients. 


‘ (a) The samples 


950 —10 0) 10 20 


(b) DFSC over one period, N, = 10 


5 4 3 2 1 0 1 2 3 4 5 
(c) DFSC repeating with sampling frequency 


® —20 —10 0 10 20 


Bin, k 
Figure 3.22: Signal of Ex. 3.8 and its Fourier coefficients (a) The discrete signal with period = 10, 
(b) the fundamental spectrum, (c) the true repeating spectrum. 


Now we write the signal in complex exponential form. 
x[n]=1+ + pin - A i 
3; 


Note that because the signal has only three components, corresponding to index k = 
—1,0, and 1, for zero frequency and k = +1, which corresponds to the fundamental 
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frequency, the coefficients for remaining harmonics are zero. We can write the coefficients 
as: 


No-1 


1 ; 
Cc. = — x[nJe kon 
m2 
1 
=—Y) x[n]eJki0" 
rep aes 


In computing the next coefficient, the value of the complex exponential for k = 1, and 
then for each value of k, we use the corresponding x[n] and the value of the complex 
exponential. The summation will give us these values. 


C= LS tye it 4" = 
‘104 2j 


CaS 1S gtujerle—Din ee 
“1044 2j 


Of course, the coefficients can be seen directly in the complex exponential form of the 
signal. The rest of the coefficients from C, to Cy are zero. However, the coefficients 
repeat after Cy so that C),9, = C, for all k. This in shown in the spectrum of the signal 
in Fig. 3.23(c). In Figure 3.23(b), only the fundamental spectrum is shown, but infact 
the spectrum repeats every 10 samples, forever. 


Example 3.9. Compute the DTFSC of this discrete signal. 
x[n] = 3 +3 cos(2n) _ 3 sin(7En) 


The period of the second term, cosine is 5 samples and the period of sine is 4 samples. 
Period of the whole signal is 20 samples because it is the least common multiple of 4 
and 5. This signal repeats after every 20 samples. The fundamental frequency of this 
signal is 
oy = 2 * 
20 10 
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. (a) The samples 


x{[n] 


‘ 


956 —10 0 10 


F Sample, 
a (b) DFSC over one period, N, =20 ce a 


—10 -5 0 5 ‘gamle wv 10 
2 (c) DFSC repeating with Fs = 20 Hz 


C(k) 


7 : : : : 
50 40 30 20 10 0 10 20 30 40 50 
Bin, k 


Figure 3.23: Signal of example 3.9 (a) The discrete signal with period = 20, (b) the fundamental 
spectrum, (c) the true repeating spectrum. 


We calculate the coefficients as 


n=0 


The FSC of this signal repeat with a period of 20. Each harmonic exponential varies 
in digital frequency by 27/20. Based on this knowledge, it can be shown that the 
27/5 exponential falls at k = 4, 2(7/10) = 27/5 and exponential 277/4 falls at k = 5, 
572/10= 2/2. 


We can also write this signal as 
2m 2m 2m 2m 
xin] = $+ (e 5" 305 ") +i ¥e 4" _ 304 ") 


From here, we see that the zero-frequency harmonic has a coefficient of 5/2. The 
frequencies +27./5 and +27/4 have coefficients of 3/2 and 3/4 as shown in Fig. 3.23(b). 


Example 3.10. Compute the DTFSC of a periodic discrete signal that repeats with 
period = 4 and has two impulses of amplitude 2 and 1, as shown in Fig. 3.24(a). 
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The period of this signal is 4 samples as we can see and its fundamental frequency is 


2m TT 
Dp — ee 
4 2 
? (a) The samples 
ce 2 
R 
1 
0 
=10 -5 0 ” 
Sample, n 
, (b) DFSC over one period, N, =4 
= 
1o) 
0 
3 2 1 0 1 
Bin, k 


i (c) DFSC repeating with Fs = 4 Hz 


C(k) 


—8 4 0 4 8 Bin,k 
Figure 3.24: Signal of Ex. 3.10. The discrete signal with period = 4 (b) the fundamental 
spectrum, (c) the true repeating spectrum. 


We write expression for the DTFSC from Eq.(3.37). 


3 

1 “tt 

C, = : > x[nJe Jka" 
n=0 


Solving this summation in closed form is hard. In nearly all such problems, we need to 
know series summations or the equation has to be solved numerically. In this case, the 
relationship is unknown. We first express the complex exponential in its Euler form. As 
known already (from Chapter 2), the values of the complex exponential for argument 
m/4 are 0 and 1 respectively for the cosine and sine. It can be written in a concise form 


cos( = = 0 and sin( =) =1. 
2 2 


We get for the above exponential 


as: 


nk 
eet (cos 5 —jsin | =(=)" 


Now substitute this into the DIFSC equation and calculate the coefficients, knowing 
there are only four harmonics in the signal because the number of harmonics are equal 
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to the fundamental . 
Crh=9 = zene iti =0.75 
Ci = zxnjeiti = 0.56 
Chao = pene ite =0.25 
Cy-3 = pene ite = 0.56 


These four values can be seen repeated in Fig. 3.24(c). 


(a) The samples 


2 
= 
alam | 
0 
—10 -6 —2 2 10 
. Sample, n 
‘: (b) DFSC over one period, No=4 
< 
S 
0 
ei] 2 1 0 1 2 Bin, k 3 
‘ (c) DFSC repeating with Fs = 4 Hz 
ZS 
S) 
0 
—10 -6 —2 2 6 Bin, k 10 


Figure 3.25: (a) The discrete signal with period = 4; (b) the fundamental spectrum; (c) the true 
repeating spectrum. 


Example 3.11. Find the DTFSC of the following sequence. 
xl] ={0, 1,2,3,0,1, 2,3, <0.) 


The fundamental period of this series is equal to 4 samples by observation. We will now 
use a compact form of the exponentials to write out the solution. 


2m 2 
W,=e74 = cos 2] —j sin( = ) =-j 
ee eee eet 


0 1 
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Note that this W is not a variable but a constant. Its value for these parameters is equal 
to —j. Now we write the coefficients as 


3 
1 
Gea =) xinlWi;.. k= Obb2 a: 
_ n=0 
From here we get 


3 
1 
Co = 3 Dy xinlw," =1.5 
n=0 


3 


3 
1 a be 
es pny =>) x{n](-j)" = 0.612 
n=0 k=0 
3 


1< > ee 
cere = Dl =0.5 
3 


3 
1 a \3n 
ai > x[n]W; a > x[n](—j)?" = 0.612. 
n=0 k=0 


DTFSC of a repeating square pulse signal 


Example 3.12. Find the DTFSC of a square pulse signal of width L samples and period 
N. 


Once again, we examine the FSC of a square pulse signal. The signal is discrete now, 
which means that it has a certain number of non-zero samples along with the zeros for 
the rest, making up one period of DT data. We set the period of the pulse to L samples, 
which is the width of the pulse. The length of the period is N samples. The duty cycle is 
defined as the ratio of the pulse width, L and the period, N. The pulse is not centered at 
the origin in this case, as shown in Fig. 3.26. This has the effect of introducing a phase 
term, as we shall see in the result. 


To compute the DTFSC, the following important property of geometric series is used. 


l-a 
a= page lala (3.39) 
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The coefficients of this signal are given as: 


12 sade N-1 Si 
C. = —)'x[nJe Tg Mk 4 Si xine Jing tk 
No n=0 0 n=L =0 
Ne 1 gin 
No n=0 
L-1 


; ate ; _ sp, 2n 
Now, we use the geometric series in Eq. (3.39) by setting a to (e/* ), We now have: 
q= (ek jy 


Using this term in Eq. (3.39), we get the following expression for the coefficients: 


—jk#ZL 

— li-e?'™ 
Ce a aE 
0 1—e 7% 


Now, pull out a common term from the numerator to write it as: 


(6 FRE 2) (eiKE NG 2 — @ SRL 2) 


The underlined part is equal to 2j sin(Lk 7). Similarly by pulling out this common term, 


-1.20 1 é 
e Jk 2, from the denominator, we get 


(6 IRR 2) (eR 2 — o IRN 2) 


The underlined term here is similarly equal to 2j sin(k;). Note the missing parameter 
L. From these, we now write the coefficients as: 


1 1—e /% 


. 2 = - 1 1 1 
No y—e 3% No e IWok(e/¥o* —e Tig) 


oe soe in 
2m rE 1e Fi Mk( elo Mk —¢ Jig) 


We manipulate this expression a bit more to get Eq. (3.40). 


1 sin(ki/No) -ingeu-y 


7 No sin(k/No) oe 


k 
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It does not look much simpler! However, if we look only at its magnitude (the front 
part) it is about as simple as we can get in DSP which is to say not a lot. The DTFSC 
magnitude for a general square pulse signal of width L and period N samples is given 
by the front part and the phase by the underlined part. If you try to plot this function 
for k = 0, you will get a singularity, so for this point, we can compute the value of the 
function using the L’Hopital’s rule, which gives the value of this function as L/N, or the 
average valve of the function over the period of N samples and certainly that makes 
sense from what we know of the dg value of a Fourier series. It is the DC value. 


(a) The samples 


15 10 5 0 5 10 15 
i (b) DFSC over one period, N, =60 Sample; 


90 60 30 0 30 60 90 
Bin, k 


Figure 3.26: (a) The discrete signal; (b) DT Fourier series (DTFSC) coefficients, (c) the true 
repeating spectrum. 


In Chapter 2, we computed the spectrum of a square pulse signal. The spectrum was 
nonperiodic sinc function, whereas this spectrum is periodic, i.e. repeats, a consequence 
of discrete time domain. This is an important new development and worth understanding. 
This function is called the Dirichlet function and is a periodic form of the sinc function. 
In Matlab, the Dirichlet function is plotted as follows: 


1 % DTFSC a square pulse train 
= 10; % Period 
= -15:14 


i) 
5 2 


4 n2 = -3*pi: .01: 3*pi' 

5 L = 5; % Wi\dt h of the pulse 

6 mag = abs(diric(2«*pixn/N, L)); % Discrete 

7 mag2 = abs(diric(2*pix*n2/N, L)); % Continuous function 
8 phase = exp(- li * n * (L -1) * pi/N) 

9 stem(n, mag); grid on; 

ro hold on; 

1 plot(n2, mag2, '-.b') 
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In Figure 3.27 the coefficients of various square pulse signals are plotted. These should 
be studied to develop an intuitive feel for what happens as the sampling rate increases 
as well the effect of the duty cycle, i.e. the width of the pulse vs. the period. Note that 
the spectrum repeat with the sampling frequency. This was not the case for CT signal. 
The Fig. 3.27 shows that as the pulses get wider, the response gets narrower. When 
the pulse width is equal to the period, hence it is all impulses, an impulse train for a 
response. This is a very important effect to know. 


7 (a) Pulse width = 1 i (b) Pulse width = 2 
vo 9 ] iP dl ¢ 
sg h 1 
2 9 ee ; 
60 ’ 
be ‘ 

as 7) 0 10 ce 

se width = 3 = 
v h rf 1 Uy B 
s B ' ; : 
FI 
a 
bb 
iso} 
= 
v 
ae) 
fs 
| 
60 
is} 
= 

Sample, n Sample, n 


Figure 3.27: Spectrum of a periodic discrete square pulse signal. We see the DIFSC change as the 

duty cycle (the width of the pulse) of the square pulse increases relative to the period. In (a), all 

we have are single impulses and, hence, the response is a flat line. In (f), as the width gets larger, 
the DTFSC take on an impulse like shape. Note that the underlying sinc does not change. 


Power spectrum 


In all the examples in this chapter, we have been plotting either the magnitude or the 
amplitude spectrum. The Power spectrum is a different thing. As per the Parseval’s 
theorem, it is defined as: 


co co 


Si xin? = >* [xfer] (3.41) 


n=—Co k=—oo 


Similar to the idea from circuits, to obtain power, we square the time-domain sample 
amplitude to obtain the instantaneous power at that time instant. If the unit of the 
amplitude is voltage, the units become voltage-squared. If all such individual squared- 
amplitudes are summed, we get the total power in the signal (assuming unity resistance.) 
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Alternately, we can sum the square of the coefficients of each harmonic. They have units 
of amplitude too. This also gives us units of voltage-squared and can be used to convert 
a DTFSC into a Power spectrum by plotting the quantity (C,)? as a function of the index, 
k, 


Matrix method for Computing FSC 


DTFSC are computed in closed-form for homework problems only. For practical app- 
lications, Matlab and other software and hardware devices are used. We will now look 
at a matrix method of computing the DTFSC. 


Let us first define this common term. It looks strange and confusing, but it is a very 
simple idea. We use it to separate out the constant terms. 


27 
Wy, =e 2%. (3.42) 


0 


For a given No, the signal period in samples, this term W, also called the Twiddle factor 
is a constant and is given a shorthand notation to make the equation writing easier. 
Using this factor, the DFS and the inverse DFS (IDFS) can be written as: 


No—-1 
DFS: X[k] = ~ x[n]wek 

n=0 

1 Nort (3.43) 
IDFS: x[n] = — > X[k]w "* 

No 2, No 


In this form, the terms Wye and Wy, nk are same as: 
jk 22 n 
wok = e! No 
No 
+7, 200 
We * gle? 


These terms can be precomputed and stored to make computation quicker. They are 
the basic idea behind the FFT algorithm which speeds up computation. The DTFSC 
equation can be setup in matrix form using the Twiddle factor and writing it in terms of 
two variables, the index n and k. Now we write: 


w 0x0 w 1x0 w2x0 w73x9 
1 wx! wx! w-2x1 wx! 
Ck = aie Ww-0x2 pr}e2 2x2 3x2 


w0x3 w7ix3 w-2x3 w73*3 


(3.44) 
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Here, we have assumed that No = 4. Each column represents the harmonic index k 
and each row the time index, n. It takes 16 exponentiations, 16 multiplications, and 4 
summations to solve this equation. We will come back to this matrix methodology again 
when we discuss DFT and FFT in Chapter 6. 


Summary of Chapter 3 


In this chapter, we examined discrete signals, the requirements for sampling set by 
Shanon and Nyquist, and methods of reconstruction. Discrete signals can experience 
frequency ambiguity, as many analog frequencies can fit through the same samples. 
If not sampled at a rate higher then Nyquist rate, we get aliasing. The Fourier series 
representation of discrete signals uses discrete basis functions. If a discrete signal has a 
period of N samples, then it only has N discrete harmonics within a 27 range. In this 
chapter, we developed the FSC for discrete signals and looked at the inverse process. 


The terms we introduced in this chapter: 


¢ Discrete signals - Defined only at specific uniform time intervals. 

* Digital signals - A discrete signals the amplitude of which is constrained to certain 
values. A binary digital signal can only take on two values, 0 or 1. 

* Nyquist rate - Two times the maximum frequency in the signal. 


Digital frequency - Measured in samples per radian. 


Aliasing - Given a set of discrete samples, a frequency ambiguity exists, as infinite 
number of frequencies can pass through these samples. This effect is called aliasing. 


Discrete time Fourier series coefficients - DTFSC which repeat are the spectrum 
of a discrete signal. 


1. An ideal discrete signal is generated by sampling a continuous signal with an 
impulse train of desired sampling frequency. The time between the impulses is 
called the sample time, and its inverse is called the sampling frequency. 

2. The sampling frequency of an analog signal should be greater than two times the 
highest frequency in the signal to accurately represent the signal. 

3. The fundamental period of a discrete periodic signal, given by No, must be an 
integer number of samples for the signal to be periodic in a discrete sense. 

4. The fundamental frequency (or digital frequency) of a discrete signal, given by 
Qo, is equal to 271/Npo. 

5. The period of the digital frequency is defined as any integer multiple of 27. 
Harmonic discrete frequencies that vary by integer multiple of 27, such as 27k 
and 27k + 27n, are identical. 

6. We increment digital frequency by itself or 27t/No, and use the N, sub-frequencies 
resulting as the basis set. These frequencies are harmonic and distinct. 
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7. 


10. 


11. 


12. 


13. 


14. 
15. 


16. 


There are only Ky harmonics available to represent a discrete signal. The number 
of available harmonics for the Fourier representation, Ko, is exactly equal to the 
fundamental period of the signal, No. 


. Beyond the 27 range of harmonic frequencies, the DT Fourier series coefficients, 


(DTFSC) repeat because the harmonics themselves are identical. 


. In contrast, the CT signal coefficients are aperiodic and do not repeat. This is 


because all harmonics of a continuous signal are unique. 
The discrete Fourier series is written as: 


The coefficients of the DTFS are written as: 


No-1 


Ch = oy x[nJeJ%ork 


n=0 


The coefficients of a discrete periodic signal are discrete just as they are for the 
CT signals. 

The coefficients around the zero frequency are called the principal fundamental 
alias or principal spectrum. 

The spectrum of a discrete periodic signal, repeats with sampling frequency, F,. 
Sometimes, DTFSC coefficients can be solved using closed form solutions but in a 
majority of the cases, matrix methods are used to find the coefficients of a signal. 
Matrix method is easy to set up but is computationally intensive. Fast matrix 
methods are used to speed up the calculations. One such method is called FFT or 
Fast Fourier Transform. 


Questions 


1. 


Given this CT signal, being sampled at F, = 25 Hz, write its discrete form. Is the 
sampling frequency above the Nyquist rate? x(t) = sin(27t) + 0.5 cos(77t) 


. If the largest frequency in a signal is f; and the lowest is f5, then what is the 


minimum frequency at which this signal should be sampled to be consistent with 
the Shannon’s theorem? 


. Why would a signal be sampled at a rate higher than two times its maximum 


frequency? 


. A Gaussian signal does not have a clear maximum frequency. What frequency do 


you choose for sampling such a signal? 


. The bandwidth of a square pulse signal is infinite. How do you choose a sampling 


frequency for such a signal? What can you do to reduce the bandwidth of this 
signal? 
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. For following three signals, what sampling frequency should be used so that it 


meets the Nyquist rate. 
(a) x = cos(50t) 
(b) y =sin(30zt) 
(c) z =sin(31.4(t + 2))—cos(40zt) 


. What is the digital frequency of a signal given by these samples: x = [11 —1 1]. 
. What is the fundamental period of a sinusoid cos(Qn + ¢), the digital frequency 


of which is given by: 0.47, 0.57, 0.67, and 0.757. 


. Adiscrete signal repeats after 37 samples. Is it periodic? A discrete signal repeats 


with digital frequency of 2707/5, is it periodic? 


. Stock data is noted every 5 s. What is its sampling frequency? 
. Temperature is measured every 10 min during the day and every 15 min during 


the night. 108 samples are collected over one day. Can we compute Fourier series 
coefficients of this data? 


. Asignal has a period of 8 samples. What is its fundamental digital frequency? 

. Why would we want to recreate a signal from its samples? 

. Are we able to transmit discrete data over an rf(analog) link? 

. We have a sequence of alternating 0’s and 1’s. What might its DFS coefficients 


look like? 


. If you have a CT signal x(t) = cos(5t) and are told to sample it at four times the 


fundamental frequency, at what rate would you sample this signal? 


. ACT signal is given by x(t) = sin(57t), if we sample it at a sampling frequency of 


20 samples per second, how would you write the discrete version of this signal? 


. A signal is sampled at the rate of 15 samples per second. What frequency is 


represented by the harmonic index k = 3 if the harmonics range from, k = -7 
to +7. 


. Digital frequency is limited to a range of 0 to 277. Why? 
. What is the minimum number of harmonics needed to represent this CT signal; 


x(t) = sin(4t + 2/5), with F, = 25. 


. A discrete signal repeats after every 12 samples. What is its digital frequency? 


What is its fundamental frequency? What is its period? 


. Asignal consists of three sinusoids of periods, N = 7, 9, and 11 samples. What is 


the fundamental period of the signal? 


. Why is a signal recreated using sinc reconstruction considered ideal? 

. If x[n] = 2cos[(27/5)n], what are its DFS coefficients? 

. If x[n] =1—sin[(27/8)n], what are its DFS coefficients? 

. What happens to the spectrum of a train of square pulses as the pulses get narrower? 
. Why does the spectrum of a periodic discrete signal repeat? The repetition occurs 


over what frequency? 
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Chapter 4 


Continuous-Time 
Fourier Transform of 
Aperiodic and Periodic Signals 


Harry Nyquist 
February 7, 1889 - April 4, 1976 


Harry Nyquist, was a Swedish-born American electronic engineer who made important 
contributions to communication theory. He entered the University of North Dakota in 1912 
and received B.S. and M.S. degrees in electrical engineering in 1914 and 1915, respectively. 
He received a Ph.D. in physics at Yale University in 1917. His early theoretical work on 
determining the bandwidth requirements for transmitting information laid the foundations 
for later advances by Claude Shannon, which led to the development of information theory. 
In particular, Nyquist determined that the number of independent pulses that could be put 
through a telegraph channel per unit time is limited to twice the bandwidth of the channel. 
This rule is essentially a dual of what is now known as the Nyquist-Shannon sampling 
theorem. — From Wikipedia 
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Applying Fourier Series to Aperiodic Signals 


In previous chapters, we discussed the Fourier series as it applies to the representation 
of continuous and discrete signals. We discussed the concept of harmonic sinusoids 
as basis functions, first the trigonometric version of sinusoids and then the complex 
exponentials as a more compact form for representing the basis signals. The analysis 
signal is “projected” on to these basis signals, and the “quantity” of each basis function 
is interpreted as spectral content, commonly known as the spectrum. 


Fourier series discussions assume that the signal of interest is periodic. However, a 
majority of signals we encounter in signal processing are not periodic. Many that we 
think are periodic are not really so. Furthermore, we have many signals that are bunch 
of random bits with no pretense of periodicity. This is the real world of signals and 
Fourier series comes up short for these types of signals. This was, of course, noticed 
right away by the contemporaries of Fourier when he first published his ideas is 1822. 
The Fourier series is great for periodic signals but how about stand-alone nonperiodic, 
also called aperiodic signals like this one? 


> 
Time, t 


Figure 4.1: Can we compute the Fourier series coefficients of this aperiodic signal? 


Taking some liberty with history, Fourier, we are sure, must have been quite disappointed 
receiving a very unenthusiastic response to his work upon first publishing it. He was 
denied membership into the French Academy, as the work was not considered rigorous 
enough. His friends and foes, who are now as famous as he is (Laplace, Lagrange 
etc.) objected to his overreaching original conclusion about the Fourier series that 
it can represent any signal. They correctly guessed that series representation would 
not work universally, such as for exponential signals as well as for signals that are not 
periodic. Baron Fourier, disappointed but not discouraged, came back 20 years later 
with something even better, the Fourier transform. (If you are having a little bit of 
difficulty understanding all this on first reading, this is forgivable. Even Fourier took 20 
years to develop it.) 


Extending the period to infinity 


In this chapter, we will look at the mathematical trick Fourier used to modify the Fourier 
series such that it could be applied to signals that are transient or are not strictly periodic. 
Take the signal in Fig. 4.1. Let us say that this little signal, as shown, has been collected 
and the data show no periodicity. Being engineers, we want to compute its spectrum 
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using Fourier analysis, even though we have been told that the signal must be periodic. 
What to do? 


Well, we can pretend that the signal in Fig. 4.1 is actually a periodic signal, but we are 
only seeing one period, the length of which is longer than the length of the data at hand. 
We surmise that if the length of our signal is 4 s, then maybe the signal looks like the top 
row of this figure with signal repeating with a period of 5 s. Of course, this is arbitrary. 
We have no idea what the period of this signal is, or if it even has one. 


<> Period 


AAANA ML 


<m ——— _ Bigger period 


De Ded 


-15 —10 =3 0 5 10 15 20 


(c) 


Even bigger period ie 


Really big period 


. . i 1 f . 1 
=15 =10 =5 0 5 10 15 20 
Time, t 


Figure 4.2: Going from periodic to aperiodic signal by extending the period. 


Because a period of 5 seconds is an arbitrary number anyway, let us just increase it 
some more by pushing these assumed copies out, increasing the time in-between. We 
can indeed keep doing this such that the time goes on forever on each side and effectively 
the period becomes infinitely long. The signal is now just by itself with zeros extending 
to infinity on each side. We declare that this is now a periodic signal but with a period 
extending to oO. We have turned an aperiodic signal into a periodic signal with this 
assumption. 


We can apply the Fourier analysis to this extended signal because it is ostensibly periodic. 
Mathematically, we have let the period T go to infinity so that the assumed periods of 
the little signal move so far apart that we see neither hide nor hair of them. The single 
piece of the signal is then one period of a periodic signal, the other periods of which 
we can not see. With this assumption, the signal becomes periodic in a mathematical 
sense, and its Fourier series coefficients (FSC) can be computed by setting its period 
to, T = oo. This conceptual trickery is needed because a signal must be periodic for 
Fourier series representation to be valid. 
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Continuous-Time Fourier Transform 


It was probably this same observation that led Fourier to the Fourier transform. We can 
indeed apply Fourier series analysis to an aperiodic signal by assuming that the period 
of an arbitrary aperiodic signal is very long and hence we are seeing only one period of 
the signal. The aperiodic data represents one period of a presumed periodic signal, x(t). 
But if the period is infinitely long, then the fundamental frequency defined as the inverse 
of the period becomes infinitely small. The harmonics are still integer multiples of this 
infinitely small fundamental frequency but they are so very close to each other that they 
approach a continuous function of frequency. So a key result of this assumption is that 
the spectrum of an aperiodic signal becomes a continuous function of the frequency and 
is no longer discrete as are the FSC. 


Figure 4.3(a) shows a pulse train with period Tp. The FSC of the pulse train are plotted 
next to it (See Ex. 2.10). Note that as the pulses move further apart in Fig. 4.3(b and 
c), the spectral lines or the harmonics are moving closer together. 


(a) VA 
1 <— Freq. resolution is 
T inversely 
o => Cc, proportional to 
‘ period. 
<= 1 + : : a4, rant th oe 
225 T, “7 5 YT, 2T, MT IF 
(b) vA ‘ 
| : >. 
< — 1 
oT a. 5 Th 
(0 pane 
T, — 00 p G, 
< Jit > 
“2 2, 
Time, t Frequency, 


Figure 4.3: Take the pulse train in (a), as we increase its period, i.e., allow more time between the 
pulses, the fundamental frequency gets smaller, which makes the spectral lines move closer together 
as in (c). In the limiting case, where the period goes to 00, the spectrum would become continuous. 


We will now go through the math to show how the Fourier transform (FT) is directly 
derived from the FSC. Like much of the math in this book, it is not complicated, only 
confusing. However, once you have clearly understood the concepts of fundamental 
frequency, period, and the harmonic frequencies, the rest gets easier. 


After we discuss the continuous-time Fourier Transform (CTFT), we will then look at 
the discrete-time Fourier transform (DTFT) in Chapter 5. Of course, we are far more 
interested in a yet to be discussed transform, called the discrete Fourier transform (DFT). 
However, it is much easier to understand DFT if we start with the continuous-time case 
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first. Although you will come across CTFT only in books and school, it is essential for 
the full understanding of this topic. 


In Equation (4.1) the expression for the FSC of a continuous-time signal is repeated 
from Chapter 2. 


To/2 
os x(t)eIKo! dt (4.1) 
—Ty/2 


To apply this to an aperiodic case, we let Ty go to co. In Eq. (4.1) as the period gets 
longer, we are faced with division by infinity. Putting the period in form of frequency 
avoids this problem. Thereafter, we only have to worry about multiplication by zero. 
We write the period as a function of the frequency. 


—=-2 (4.2) 


If Tp is allowed to go to infinity, then wo is becoming tiny. In this case, we write frequency 
@g as Aw instead, to show that it is becoming infinitesimally smaller. Now we write 
the period in the limit as 


lim — & — (4.3) 


We rewrite Eq. (4.1) by substituting Eq. (4.3). 


To/2 
x(t)e ko! dt (4.4) 
~T/2 


Aw 


Cc, = — 
: 27 


But now as Toy goes to infinity, Aw approaches zero, and the whole expression goes 
to zero. To get around this problem, we start with the time-domain Fourier series 
representation of x(t), as given by 


x(t) = os Ce ot (4.5) 


k=—oo 


Now substitute Eq. (4.4) into Eq. (4.5) for the value of C; to write 


[eve) Kes To/2 
x(t) = >, { se | x(t)e I? dt pehon (4.6) 
k=—oco 


27 1/2 


C 


We now change the limits of the period, Tp, from a finite number to oo. We also change 
Aw to dw, and kw to just w, the continuous frequency and the summation in Eq. (4.6) 
now becomes an integral. Furthermore, the factor 1/27 is moved outside. Now, we 
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rewrite Eq. (4.6) incorporating these ideas as: 


x(t) = =| {| x(t)e I?! ac} et dw (4.7) 


co —oo 


We give the underlined part a special name, calling it the Fourier transform and refer 
to it by the expression, X(w). Substituting this nomenclature in Eq. (4.7) for the 
underlined part, we write it in a new form. This expression is called the inverse Fourier 
transform and is equivalent to the Fourier series representation or the synthesis equation. 


x(tj)= x | X(wyel?! dw (4.8) 


—oo 


The CTFT is defined as the underlined part in Eq. (4.8) and is equal to 


X(w) = | x(t)e I? dt (4.9) 


—oo 


In referring to the Fourier transform, the following terminology is often used. If x(t) 
is a time function, then its Fourier transform is written with a capital letter. Such as 
for time-domain signal, y(t) the CTFT would be written as Y(w). These two terms are 
called a transform pair and often written with a bidirectional arrow in between them 
such as here. 

y(t) Yl) y(t) SS ¥(w) 

c(t) <> C(w) c(t) > C(w) 


The symbol ${-} is also used to denote the Fourier transform. The symbol 3 !{-} is used 
to denote the inverse transform such that 


Y(w) = H{y(t)} 
g(t)=F {G(w)} 


The CTFT is generally a complex function. We can plot the real and the imaginary parts 
of the transform, or we can compute and plot the magnitude, referred to as |X(w)| and 
the phase, referred to as ZX(w). The magnitude is computed by taking the square root 
of the product X(@)X*(w) and phase by the arctan of the ratio of the imaginary and the 
real parts. We can also write the transform this way, separating out the magnitude and 
the phase spectrum. 

X(w) = [K(w) ei 


Here we have the two important aspects of a spectrum, its magnitude and its phase. 
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* Magnitude Spectrum: |X(w)| 
* Phase Spectrum: Z2X(w). 


If the two components of a CE each have an amplitude 1.0 each, then its magnitude is 
equal to the square-root of 2. The phase of a CE is constant and equal to 0. 


Comparing FSC and the Fourier Transform 


Fourier Decomposition of Signals 


Fourier Series Fourier Fourier Series Fourier 
Coeffcients Transform Coeffcients Transform 


(C-FSC) (CTFT) (D-FSC) (DTFT) 


Periodic Non-periodic Periodic Non-periodic 


Figure 4.4: Fourier series and the Fourier transform 


The Fourier series analysis can be used with both discrete and continuous-time signals 
as long as they are periodic. When a signal is aperiodic, the premium tool of analysis 
is the Fourier transform. Just as the Fourier series can be applied to continuous and 
discrete signals, the Fourier transform can also be applied to continuous and discrete 
signals. The discrete version of the Fourier transform is called the discrete-time Fourier 
transform, (DTFT) and will be discussed in the next chapter. 


Let us compare the CTFT and the FSC equations. Recall that we are trying to determine 
the amplitudes of each of the harmonics used to represent the signal. The FSC and the 
CTFT are given as: 


Tp/2 
FSC: C, = — x(t)eJkeot dt 
10 Jto/2 (4.10) 
; 
CTFT: X(w) = i x(t)e J! dt 
—oo 


In the CTFT expression, we note that the time no longer extends over a period, but 
extends to infinity. That is because the period itself now extends to infinity. We see that 
the period T, in the front of FSC is missing from the latter. Where did it go and does 
it have any significance? We started development of CTFT by stretching the period and 
allowing it to go to infinity. We also equated 1/Tp to dw/27 which was then associated 
with the time-domain formula or the inverse transform (it is not included in the center 
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part of Eq. (4.8), which became the Fourier transform). Therefore, it moved to the 
inverse transform as the factor 27. 


Notice now the difference between the time-domain signal representation as given by 
the Fourier series and the Fourier transform. 


[oe) 
FSC: x(t) = > Cel teat 
noe (4.11) 


tae ae : 
CTFT: x(t) = x | X(w)e!?! dw 
2m} ee 
We no longer see the harmonic index k in the CTFT equation as compared to the FSC 
expression. This is because the frequency resolution cw is infinitesimally small for CTFT 
and essentially the term kw is continuous. For example, if w9 is equal to 0.001, then 
integer multiple of this number are very close together and hence nearly continuous. 
The summation of the FSC over the harmonic index k hence, becomes an integral over 
« for the CTFT. Hence what is a summation for FSC, is an integral for the CTFT. 


In Fourier series representation, to determine the quantity of a particular harmonic, the 
signal is multiplied by a harmonic, the product integrated over one period and result 
normalized by the fundamental period Ty. This gives the amplitude of that harmonic. 
Infact, this is done for all K harmonics, each divided by Tp. In Fourier transform, 
however, we do not divide by the period because we don’t know what it is. It is assumed 
that it is co, but we would not want to divide by that either. Therefore, we just ignore 
it, and hence, we are not determining the signal’s true amplitude. We are computing a 
measure of its content but it is not the actual content. Moreover, we are missing the same 
term from all coefficients, hence, the Fourier transform determines relative amplitudes. 
Very often, we are only interested in the relative levels of harmonic signal powers. The 
Fourier spectrum gives us the relative distribution of power among the various harmonic 
frequencies in the signal. In practice, we often normalize the maximum power to 0 dB 
such that the relative levels are consistent among all frequency components. 


CTFT of Important Aperiodic Functions 


Now, we will take a look at some important aperiodic signals and their transforms, 
also called transform pairs. In the process, we will use the properties listed in Table 4.1. 
which can be used to compute the Fourier transform of many functions. These properties 
do not need proof as they are well known, and we will refer to them as needed for the 
following important examples. (In most cases, they are easy to prove.) The examples 
in this section cover some fundamental functions that come up both in workplace DSP 
as Well in textbooks, so they are worth understanding and memorizing. We will use the 
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properties listed in Table 4.1 to compute the CTFTs in the subsequent examples in this 
and the following chapters. All following examples assume that the signal is aperiodic 
and is specified in continuous-time. The Fourier transform in these examples is referred 
to as CTFT. 


Table 4.1: Important CTFT properties 


co 
Zero value X(0)= | x(t) dt 
—oCo 
Duality If x(t) > X(w), then X(t) — x(w) 
Linearity ax(t)+ by(t) - aX(w)+ bY(w) 
Time Shift x(t — tg)  e J°X(w) 
Frequency Shift eJol x(t) > X(w— wy) 
Time Reversal x(—t) << X(—w) 
Time expansion or contraction x(at)< ax (2 ) a#0. 
atk d : 
Derivative qh) — jwX(w) 
Convolution in time x(t) *h(t) @ X(@)H(w) 
Multiplication in Time x(t)y(t) @X(w)*Y(w) 
[oe) a, co 
Power Theorem i |x(t)|* dt = — [ IX(w)|? dw 
a 2m J 66 


CTFT of an impulse function 


Example 4.1. 
x(t) = 6(t) (4.12) 


This is the most important function in signal processing. The delta function can be 
considered a continuous (Dirac delta function) or a discrete function (Kronecker delta 
function), but here we treat it as a continuous function. We use the CTFT equation, 
Eq. (4.9) and substitute delta function for function x(t). 
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(a) Impulse of Amplitude 1 1 


x(t) = 6(t) 


0 Time, t 
(b) Its CTFT is a constant 
1 X(w)=1 


0 Frequency, 


Figure 4.5: CTFT of a delta function located at time O is a constant. 


We compute its CTFT as follows. 


X(w)= [ x(t)e J! dt 


—oo 


loo) 
=| d(t)e I?! dt 


—oo 
_ e Je(t=0) 


=1 
In the third step, the sifting property of the delta function is used. The sifting property 


states that the integral of the product of a CT signal with a delta function isolates the 
value of the signal at the location of the delta function per Eq. (4.13). 


[ 6(t —a)x(t) dt = x(a). (4.13) 


—oo 


If a = 0, then the isolated value of the complex exponential is 1.0, at the origin. The 
integrand becomes a constant, so it is no longer a function of frequency. Hence, CTFT 
is constant for all frequencies. We get a flat line for the spectrum of the delta function. 


The delta function was defined by Dirac as a summation of an infinite number of exponentials. 
1 co 
(= x | eJl day (4.14) 
2T | 66 
The same equation in frequency domain is given by: 
1 co 
6(w)= x | el dt (4.15) 
27 


—oo 
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The general version of the Dirac delta function with a shift for time and frequency is 
given as: 


1 [oe) 
5(t—to) = x | elolt—to) dey (4.16) 
—oo 
loo) 
1 j(@—eg)t 
d(w— Wo) = o e o” dt (4.17) 
—oo 


In the transform of a delta function, we see a spectrum that encompasses whole of the 
frequency space to infinity, hence, a flat line from —oo to +00. Infact when in Chapter 
1, Fig. 1.9, we added a whole bunch of sinusoids, this is just what we were trying to get 
at. This is a very important property to know and understand. It encompasses much 
depth and if you understand it, the whole of signal processing becomes easier. 


Now, if the CTFT or X(w) = 1, then what is the inverse of this CTFT? We want to find 
the time-domain function that produced this function in frequency domain. It ought to 
be a delta function but let us see if we get that. Using the inverse CTFT Eq. (4.8), we 
write 


x(t)=F {1} 
a 1 as 
oe il 


= 6(t) 


1-2e/@! dw 


Substituting in the second step, the definition of the delta function from Eq. (4.14), 
we get the function back, a perfect round trip. The CTFT of a delta function is 1 in 
frequency-domain, and the inverse CTFT of 1 in frequency-domain is the delta function 
in time-domain. 


CTFT Inverse CTFT 
3) ei) 


CTFT of a constant 


Example 4.2. What is the Fourier transform of the time-domain signal, x(t) = 1. 


This case is different from Ex. 4.1. Here, the time-domain signal is a constant and not a 
delta function. It continues forever in time and is not limited to one single time instant 
as is the first case of a single delta function at the origin. Using Eq. (4.9), we write the 
CTFT as: 


X(w)= | x(t)e J! dt 


1-¢e Jt dt 


II 
| : 
Q 8 
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Using Eq. (4.15) for the expression of the delta function, we get the CTFT of the constant 
1 as: 


X(w) = 276(w) 


It can be a little confusing as to why there is a 27 factor, but it is coming from the 
definition of the delta function, per Eq. (4.15). 


(a) A constant function 1 x(t) = 


0 Time, t 
(b) Its CTFT is an impulse 
A 
X(w) = 276(w) | Qn 
0 Frequency, w 


Figure 4.6: CTFT of a constant function that shows reciprocal relationship with Ex. 4.1. 


If the time-domain signal is a constant, then its Fourier transform is the delta function 
and if we were to do the inverse transform of 2776(w), we would get back x(t) = 1. We 


can write this pair as: 


1 2785(w) 


Note in Ex. 4.1, we had this pair 6(t) <> 1, which is confusingly similar but is not the 
same thing. Note that in this case the FT is 27 larger than the result from Ex. 1. In this 
case the signal continues forever so we ought to expect this FT to be larger. 


CTFT of a sinusoid 


Example 4.3. Since a sinusoid is a periodic function, we will select only one period of 
it to make it aperiodic. Here, we have just a piece of a sinusoid. We make no assumption 
about what happens outside the selected time frame. The cosine wave shown in Fig. 4.7 
has a frequency of 3 Hz, hence, you see one period of the signal lasting 0.33 s. 


a i c., ACe ey ee ee) ee cc 


Amplitude 


0) 0.05 0.1 0.15 0.2 0.25 0.3 
Time, t 


Figure 4.7: A piece of a sinusoid is an aperiodic signal. 
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We can compute the CTFT of this little piece of cosine as: 
X(w) = F{cos(wot)} 


ike? 
= ~(el@ol 4 eJOot elt de 
2 


—oo 
fora) 1 fore) 1 

= = eilwteo)t dt+ = eile—ao)t dt 
6S 2 =o 2 


Note that each of these integrals can be represented by a shifted delta function in 
frequency domain. We use Eq. (4.17) to write this result as: 


X(@) = 16(w + Wo) + 14(w — Wo) (4.18) 


The only difference between the CTFT of a cosine wave and FSC in Ex. 4.1 is the scaling. 
In the case of FSC, we get two delta functions of amplitude 1/2 for each or a total of 1. 
The amplitude of each component in this case is, however, 7 , or 27 times the amplitude 
of the FSC. 


By similarity, the Fourier transform of a sine is given by 
X(@) = S{sin(wot)} = j(76(w + wo) — 26(w — wW9)) (4.19) 


The presence of j in front just means that this transform is in the imaginary plane. It has 
no effect on the amplitude. We do however, see that the component at —w, frequency 
has a negative sign as compared to the cosine CTFT in Eq. (4.18) where both components 
are positive. This will come into play in the next example when we do the CTFT of a 
complex exponential. 


CTFT of a complex exponential 


Example 4.4. Now we calculate the CTFT of a very important function, the complex 
exponential. 

x(t) = eo = cos(wot) + j sin(wot) 
A CE is really two functions, one a cosine of frequency wg and the other a sine of the 
same frequency, both orthogonal to each other. 


We have already calculated the CTFT of a sine and a cosine given by: 


B{cos(wot)} = 76(w + Wo} + 16(wW— Wo) (4.20) 
S{sin(wot)} = j6(w + wo) — j6(w + wo)) (4.21) 


By the linearity principle, we write the Fourier transform of the CE keeping the sine and 
cosine separate. 
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(a) Re(e”") = cos(ut) (c) X(w) = 6 — 4, )+6W+4 wy) 


NAA ted 


(b) Im(e’”") = sin(a,t) 


ae 


Time, t Frequency, w 


Figure 4.8: The CTFT of a complex exponential. 
The Real part is a cosine, hence the spectrum looks like Fig. 4.8(a) and the Imaginary part is a 
sine, and hence this plot is exactly the same as Fig. 4.8(b). 


F{el} = F{cos(wot)} + jF{sin(wot)} 
= 15(w + Wo) + M5(w — wo) + j2(15(w + Wo) — j226(w — “o)) 
a ” (4.22) 
= 16(w— Wo) — j225(w — Wo) + 15(w + Wo) + j225(w + Wo) 
— (NEE 
add cancel 


= 2716(w — wo) 


The result is a single delta function located at wo. This happens because of an addition 
and a cancellation of the components. We see in Fig. 4.9 that the sine component at 
frequency +a, because it is multiplied by aj, rotates up or counter clockwise and adds to 
the cosine component. On the other side, at frequency —w the sine component coming 
out of the paper also rotates counter clockwise, because of its multiplication by j, which 
puts it directly in opposition to the cosine component and they both cancel. All we are 
left is a double component at the positive frequency. Hence, we get an asymmetrical 
result. 


Example 4.5. Compute the iCTFT of a single impulse located at frequency wy. 
X(@) = 6(w— a) 


We want to know what time-domain function produced this spectrum. We take the 
iCTFT per Eq. (4.8). 


x(t) = ${5(w— w,)} 


a 1 
= 2 | 5(w— w,)eI?* dw = —e)1" 
268 27 
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The result is a complex exponential of frequency «, in time-domain. Because this is a 
complex signal, it has a non-symmetrical frequency response that consists of just one 
impulse located at the CE’s frequency. In Fig. 4.9, we see why it is one sided. 


A From sine 


(a) : F 
: Rotated up by +j 
e 


From cosine 


i 
Rotated down by -j V 


Ww, Frequency 


(b) 


Cancels 


Frequency 
Figure 4.9: The asymmetrical spectrum of a complex exponential. 


Here, we write the two important CTFT pairs. The CTFT of a CE is one-sided, an impulse 
at its frequency. (The CTFT of all complex functions are asymmetrical.) 


eJ0t ¢ » 2775(w — Wo) (4.23) 
e Jot ¢s 275(w + Wo) (4.24) 


Time-shifting a function 


Discrete signals can be constructed as summation of time-shifted delta functions. Hence, 
we ask, what is the CTFT of a delta function shifted by a time shift, tp? This case is very 
important to further understanding of discrete signals. 


We can determine the response of a delayed signal by noting the time-shift property in 
Table 4.1. The property says that if a function is delayed by a time period of tg, then in 
frequency domain, the original response of the undelayed signal is multiplied by a CE of 
frequency e/®, In this signal, time is constant and, hence, this is a frequency-domain 
signal, with frequency being the variable. 


We write the shifted signal as x(t) = 6(t— tg). Now we calculate the Fourier transform 
of this function from Eq. (4.9) as: 


X(w) = [ x(t)e J! dt 


—oo 


loo) 

= [ d(t —to)e /°' dt 
—Cco 

= e Jeto 
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In Ex. 4.1, for a undelayed delta function, the CTFT was computed as 1.0. Here the 
result is the exponential due to the delay, hence proving the time-shift property. The 
CTFT of a delayed delta function is a CE. This CE has the form e/® and might be 
confusing. That is because we are not used to seeing exponentials in frequency domain. 


This is a really simple case so we may ask, what is the effect of delay on an arbitrary 
CTFT? Delaying a signal does not change its amplitude (the main parameter by which 
we characterize signals.) Its frequency also does not change, but what does change is 
its phase. If a sine wave is running and we arrive to look at it at time tg after it has 
started, we are going to see an instantaneous phase at that time that will be different 
depending on when we arrive on the scene. That is all a time shift does. It changes the 
observed phase (or the starting point of the wave) of the signal. 


(a) ae a X(w) 


= 
E foe 

i e = cos(wt,) — jsin(wt,), t, =2 ie e™ = cos(wt,) — jsin(wt,), t, =4 
eS Y 
: ee con 
zal mill 

- Xue ei @ oe ei 
3 ae. 
5 
iene 2 

5 ® ZX(w) e” (h) ZX(w) e*” 
. ——— ee 

“0 eck SRRERER AAD 
Frequency, w Frequency, w 


Figure 4.10: Signal delay causes only the phase response to change. In (a) and (e) we see spectrum 
of an arbitrary undelayed signal, (b) the signal delayed by 2 s, (f) same signal delayed by 4 s. 
Both cases have the same magnitude as in (c) and (g) but the phase is different as in (d) and (h). 


Figure 4.10 shows the effect of time-delay. In Fig. 4.10(a), a signal with an arbitrary 
spectrum centered at frequency of 2 Hz is shown. The time-domain signal is not shown, 
only its Fourier transform. You only need to note its shape and center location on the 
frequency axis. Now we delay this signal by 2 s (we do not know what the signal is, but 
that does not matter.) and want to see what happens to the spectrum. 


In Fig. 4.10(b) we draw the CE eJ@to with to = 2 (both sine and cosine are shown). In 
Fig. 4.10(c), we see the effect of multiplying this CE by the spectrum in Fig. 4.10(a). The 
magnitude is unchanged. But when we look at Fig. 4.10(d) we see the phase. Since we 
do not know what the previous phase was, no statement can be made about it yet. Now 
examine the second column. In this case, the signal is delayed by 4 seconds. Once again 
in Fig. 4.10(g) we see no change in magnitude but we see that phase in Fig. 4.10(h) has 
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indeed changed from previous case in Fig. 4.10(d). The phase change is directly related 
to the delay. 


Duality with frequency shift 


If a signal is shifted in time, the response changes for phase but not for frequency. Now 
what if we shift the spectrum by a certain frequency, such as shifting X(w) to X(w—w9), 
i.e, the response is to be shifted by a constant frequency shift of wo. We can do this by 
using the frequency shift property. In order to effect this change or frequency-shift, we 
need to change the time-domain signal as: 


X(w— Wo) ef 0 x(t) (4.25) 


Hence, if a time-domain signal is multiplied by a CE of a certain frequency, the result is 
a shifted frequency response by this frequency. We show this here. 


F{el?o'x(t)} = i eJolx(t)eI°! dt 
: if stones (4.26) 
= X(w— Wo). 


The frequency shift property shown here is also called the modulation property. Modu- 
lation, also called upconversion, can be thought of as multiplying, in time-domain, a 
signal by another single-frequency signal (called a carrier) and infact if you look at 
Eq. (4.25), that is exactly what we are doing. A time-domain signal multiplied by a CE, 
e/o" results in the signal transferring to the frequency of the CE, «9 without change in 
its amplitude. 


Convolution property 
The most important result from the Fourier transform is the convolution property. Infact 
the Fourier transform is often used to perform convolution in hardware instead of doing 


convolution in time-domain. The convolution property is given by 


(oe) 
x(t) * h(t) | x(t)h(t —7) dt (4.27) 
—oco 
In time-domain, convolution is a resource-heavy computation. However, convolution 
can be done using less computational effort using the Fourier transform. The convolution 
property states: 
x(t) * h(t) -— X(w)H(w) (4.28) 
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This states that the convolution of two signals can be computed by multiplying their 
individual Fourier transforms and then taking the inverse transform of the product. Let 
us see why this is possible. We write the time-domain expression for the convolution 
and then take its Fourier transform. Yes, it does look messy and requires fancy calculus. 


S{x(t) «h(t)} = x | x(t)A(t — 7) ac} 


[oe) 
(oe) [oe) 
= | | x(t)h(t —t)dte I”! dt 
—oco J—0o 


Now, we interchange the order of integration to get this from 
(oe) co 
S{x(t) *h(t)} -| to [ h(t —t)e I?" i) dt 
—oo —co 
We make a variable change by setting u = t — T, hence we get 
loc) co 
F{x(t) *h(t)} = | sto [ nude Fa) dt 
—oo —oo 
This can be written as: 


S{x(t) *h(t)} = | xt [ h(uderPterF*" du dt 


—oo —oo 


Now we move the e/®* term out of the inner integral because, it is not function of u, 
to get the desired result and complete the convolution property proof. 


soacosncen=( | x(t)e I? ac)( | h(ade?*du) 
= X(w)H(w) 


The duality property of the Fourier transform then implies that if we multiply two 
signals in time-domain, then the Fourier transform of their product would be equal 
to convolution of the two transforms. 


x(t)h(t) = X() * H(w) (4.29) 


This is an efficient way to compute convolution rather than the standard way we learn 
by reversing and multiplying the signals. Convolution is hard to visualize. The one way 
to think of it is as smearing or a smoothing process. The convolution process produces 
the smoothed version of both of the signals as we can see in Fig. 4.11. Both of the pulses 


128 


CHAPTER 4. FOURIER TRANSFORM OF APERIODIC AND PERIODIC SIGNALS 


in Fig. 4.11(a and d) have been smoothed out by their convolution by the center pulse. 
They have also spread in time as in Fig. 4.11(c and f). 


(a) x(t) (b)_y(t) (c) x@)* y(t) 


wo 1 
us) 
3 
£ 
3 
“| 


10 15 20 10 15 20 
(d) x@ (e) yO) (f) x(t) * y(t) 
3 
B 
10 15 20 10 15 20 
Time, t 


Figure 4.11: (a) The convolution of signals x(t) and y(t) in (c) is done using Fourier transform. 
In each case, the result is smoother than either of the original signals. Hence, convolution can be 
thought of as a filter. 


CTFT of a Gaussian function 


Example 4.6. Now we examine the CTFT of a really unique and useful function, the 
Gaussian. The zero-mean Gaussian function is given by 


1 2 2 
=e (4.30) 
oVv2T 
where o? is the signal variance and o the standard deviation of the signal. This form 
of the Gaussian is particular to signal processing. A general Gaussian signal is often 
written in this form. 
faa ye (4.31) 
Here a is the peak height of the familiar bell curve, b is the center point of the curve 
and c is the standard deviation. 


The CTFT of the Gaussian function is very similar to the function itself. 


co 

1 2 2 i‘ 

X(w)= ———¢ P/CO) e-iot dp 
[. ov2T 


42/952 _3 
e t*/20° 6 jet dy 


7 |. 


This is a difficult integral to solve but fortunately smart people have already done it for 


us. The result is 1 a8 
X(w)= i ae (4.32) 
(2) 2o0Vv2T 
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As o is a constant, the shape of this curve is a function of the square of the frequency, 
same as it is in time-domain where it is square of time. Hence, it is often said that the 
CTFT of the Gaussian function is same as itself, but what they really mean is that the 
shape is the same. This property of the Gaussian function is very important in nearly 
all fields. However, as we see in Eq. (4.32), there is no hard cutoff in the response 
and hence the bandwidth of this signal is not finite. How fast it decays depends on 
the parameter, o, the standard deviation. If the x-axis is normalized by the standard 
deviation, the response becomes the normal distribution. In signal processing, we find 
that often noise can be modeled as a Gaussian process. We also find that when Gaussian 
signals are added or convolved, their joint distribution retains its Gaussian distribution. 


CTFT of a square pulse 
Example 4.7. Now, we examine the CTFT of a square pulse of amplitude 1, with a 


period of t, centered at time zero. This case is different from the ones in Chapters 2 
and 3 in that here we have just a single solitary pulse. This is not a case of repeating 
square pulses as in this section we are considering only aperiodic signals. 


(a) r=2 (c) X(w) 
A 
> 
7 r > > 
~z O @ Time t “tgs Frequency “ 
(b) T=1 (d) X(w) 
A 
> 
z z= > WwW 
2 07 Time t —T us Frequency 


Figure 4.12: Spectrum along the frequency line. A square pulse has a sinc-shaped spectrum. (a) its 
time-domain shape, and (b) its CTFT. 


We write the CTFT as given by Eq. (4.9). The function has an amplitude of 1.0 for the 
duration of the pulse. 


—oo 


T/2 
| Tee 2” dt 
—7/2 


t/2 


X(w)= | x(Hje”* dé 


e jet 


II 


jo —t/2 
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= —+ (cier2 _ gon) 
jw 
2. (S) 
= — sin| — 
w 2 
This can be simplified to 
X(w) = csine( 2 (4.33) 
27 


The spectrum is shown on the right side in Fig. 4.12 for t = 1s and 2s. Note that as the 
pulse gets wider, the spectrum gets narrower. As the sinc function is zero for all values 
that are integer multiple of 27, the zero crossings occur whenever wt = kz, where k 
is an even integer larger than 2. For t = 2, the zeros would occur at radial frequency 
equal to 7,27,.... If the pulse were to become infinitely wide, the CTFT would become 
an impulse function. If they were infinitely narrow as in Ex. 4.1, the frequency spectrum 
would be flat. 


Now assume that instead of the time-domain square pulse shown in Fig. 4.12, we are 
given a frequency response that looks like a square pulse. The spectrum is flat from —W 
to +W Hz. This can be imagined as the frequency response of an ideal filter. Notice, 
that in the time-pulse case, we defined the half-width of the pulse as T/2, but here we 
define the half bandwidth by W and not by W/2. The reason is that in time-domain, 
when a pulse is moved, its period is still t. However, bandwidth is designated as a 
positive quantity only. There is no such thing as a negative bandwidth. In this case, the 
bandwidth of the signal (because it is centered at 0 is said to be W Hz and not 2W Hz. 
However, if this signal was moved to a higher frequency such that the whole signal was in 
the positive frequency range, it would be said to have a bandwidth of 2W Hz. This crazy 
definition gives rise to the concepts of low-pass and band-pass bandwidths. Low-pass is 
defined as being centered at the origin so it has half the bandwidth of band-pass. 


(a) Since shape (b) Its CTFT 
1 X(w) = rect| 

(w) = rec ra 

Ww 

> > 
4n_ 3m _ 20 #. Q & Qn 3x 4n —Ww 0 Ww 

w WwW Ww w Ww Ww Ww Ww 

Time Frequency 


Figure 4.13: Time-domain signal corresponding to the rectangular frequency response. 


Example 4.8. What time-domain signal produces a rectangular frequency response 
shown in Fig. 4.13(b)? The frequency response is limited to a certain bandwidth, W 


Hz. 
1 |jo|<W 
X(w)= 
0 |w|>Ww 
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We compute the time-domain signal by the inverse CTFT equation. 


x(t) = x | X(w)el?* dw 


—oo 
co 
1 ; 
se 1-2 dw 
2m) 66 
1 eet Ww 
2x jt |_w 
Which can be simplified to 
WwW. Wt 
x(t) = —sinc| — (4.34) 
T T 


Again we get a sinc function, but now in time-domain. This is the duality principle at 
work. This is a very interesting case and of fundamental importance in communications. 


The frequency spectrum shown in Fig. 4.13(b) is, of course, a very desirable frequency 
response. We want the frequency response to be tightly constrained. The way to get 
this type of spectrum is to use a time-domain signal that has a sinc pulses. But a sinc 
function looks strange as a time-domain signal because it is of infinite length. However, 
because it is “well-behaved,” which means it crosses zeros at predicable points, we can 
use it as a signal shape, at least in theory. In practice, it is impossible to build a signal 
shape of infinite time duration. It has to be truncated, however, truncation causes 
distortion and we do not get the perfect brick-wall frequency response. An alternate 
shape with similar properties is the raised cosine, most commonly used signal shape in 
communications. The raised cosine shape is also truncated to shorten its length but its 
distortion is manageable because it decays faster than a sinc shape. 


In Fig. 4.14 some important Fourier transforms of aperiodic signals are given. A good 
engineer should know all of these by heart. 


Fourier Transform of Periodic Signals 


The Fourier transform came about so that the Fourier series could be made rigorously 
applicable to aperiodic signals. The signals we examined so far in this chapter are all 
aperiodic, even the cosine wave, which we limited to one period. Can we use the CTFT 
for a periodic signal? Our intuition says that this should be the same as the Fourier 
series. Let us see if that is the case. 


Take a periodic signal x(t) with fundamental frequency of wy) = 27/T, and write its FS 
representation. 


loo) 
y= >» C,eot 


k=—0o 
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Time-domain signal Frequency-domain amplitude 


(a) Sinc shape 


1 X(w) = rect ea 


(b) Rectangular pulse 


1 t 
x(t) = ree] 
z 
=» 
> ¢t 
== 04 


(c) Triangular pulse 


1 x(t) = triang {| 
ee 


(d) Impulse train 


x= D> 6(e—nt) = 225 fa 
ie 
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(e) Gaussian pulse 


X(w) =a Ine 7 


oV2n 


x(t) = et 20? 


Figure 4.14: Response to a Sinc shaped time domain signal. 


Taking the CTFT of both sides of this equation, we get 
co 
x(o) = 50} =3{ >? Celt} 
k=—0o 
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We can move the coefficients out of the CTFT because they are not function of frequency. 
They are just numbers. 


X(w)= DY) Heleot} 


k=—co 


The Fourier transform of the complex exponential e/9' is a delta function located at 
the frequency wo as in Ex. 4.4. Making the substitution, we get 


X(w)=2n Dy C,.6(w—kwo) (4.35) 


k=—co 


This equation says that the CTFT of a periodic signal is a sampled version of the FSC. 
The FSC are being sampled at frequency of the signal, w 9, with k the index of repetition. 
However, the FSC are already discrete! Thus, the only thing the Fourier transform does 
is change the scale. The magnitude of the CTFT of a periodic signal is 27 times bigger 
than that computed with FSC as seen by the factor 27 front of Eq. (4.35). 


Important observation: The CTFT of an aperiodic signal is aperiodic and continuous whereas 
the CTFT of a periodic signal is aperiodic but discrete. 


CTFT of a periodic square pulse train 


Example 4.9. Now we examine the CTFT of the periodic square pulse. For the Fourier 
transform of this periodic signal, we will use Eq. (4.35) 


X(w)=27 BS C,.O(@ — kw) 


k=—0o 


The FSC of a periodic pulse train with duty cycle = 1/2 are computed in Chapter 2 and 
given as 


1 
C. = gsine(kn/2) 


We plot these FSC in Fig. 4.15(b). To compute CTFT, we set wy = 1 and now we write 
the CTFT expression as: 


X(w)=27 >», C,.5(w—k(wo = 1)) 


k=—co 


The result is the sampled version of the FSC scaled by 27 (See Ex. 2.10) which are of 
course themselves discrete. 
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a ii T T T t T > 
0 -2T , Ty ~ 


(a) Fourier series coeff. C, 


Frequency 
Figure 4.15: The periodic square wave with duty cycle of 0.5. (b) Its FSC and (c) its CTFT. Only 
the scale is different. 


What if the square pulse was not centered at O but shifted some amount. We can 
compute the CTFT of this periodic function by applying the time-shift property to the 
CTFT of the unshifted square wave. 


(a) The signal Shifted from center by r/2 


-(3h +4) -(2h+5)-(+3) 0 T +g A+z Time 


4 (b) CTFT X(w)e -**"? 


Frequency 


Figure 4.16: A time-shifted square pulse train. 
This periodic function is same as Fig. 4.15 but is time-shifted. We can write it as: 
y(t) = x(t — 7/2) 


By the time-shift property, we can write the CTFT of this signal by multiplying the CTFT 
of the unshifted case by e/®*/2. Hence 


Y(w) =X(w)ele/? 
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which is ae 
Y(w) = (2x = C,6(w — Ke 
k=—0o 
This time shift has no effect on the shape of the response at all, just as we would expect. 
Only the phase gets effected by the time shift. 


The main reason we do a Fourier transform rather than the Fourier series representation 
and its coefficients, is that the Fourier transform can be used for aperiodic and peri- 
odic signals. There is, however, a key difference between the FSC and the CTFT. We 
calculate actual amplitudes with FSC. However, in developing the Fourier transform, 
we dropped the concept of a period, hence, the results are useful in a relative sense 
only. The Fourier transform is not a tool for measuring the real signal amplitudes but is 
mostly used as a qualitative tool for assessing relative amplitudes, power and issues of 
bandwidth occupation. 


Summary of Chapter 4 


In this Chapter we looked at aperiodic signals and their frequency representations. The 
FS concept is extended so that Fourier analysis can be applied to aperiodic signals. 
In a manner similar to computing the coefficients, we call the process of computing 
the coefficients of aperiodic signal the Fourier transform. The spectrum of continuous 
signals using the Fourier transform is continuous, where the Fourier transform of a 
periodic signal is discrete. 


Terms used in this chapter: 


¢ Fourier Transform, FT 

¢ Continuous-time Fourier Transform, CTFT 

¢ Discrete-time Fourier Transform, DTFT 

¢ Transform pair - The signal in one domain and its Fourier transform in the other 
domain are called a Fourier transform pair. 


1. Aperiodic signals do not have mathematically valid FSC. 

2. Fourier transform is developed by assuming that a aperiodic signal is actually 
periodic but with an infinitely long period. 

3. Whereas the spectrum of a periodic signal is represented by the Fourier series 
coefficients, the spectrum of an aperiodic signal is called the Fourier transform. 

4. The term Fourier transform applies not just to aperiodic signals but to periodic 
signals as well. 

5. The FSC are discrete whereas the CTFT of an aperiodic signal is continuous in 
frequency. 
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10. 
11. 


. The CTFT of aperiodic signals is aperiodic. 
. The CTFT and the iCTFT are computed by: 


loo) 
CTFT X(w) =I x(t)e I?! dt 
—oo 
if 
iCTFT x(t) = x | X(w)el?' dw 
PS) ee 


. A function and its Fourier transform are called a transform pair. 


x(t) X(w) 


. The CTFT of a periodic signal is given by the expression 


co 
X(w) =27 > C,.O(@ — kw) 
k=—0o 
The CTFT of a periodic signal can be considered a sampled version of the FSC. 
Unlike the CTFT of an aperiodic signal, the CTFT of a periodic signal is discrete, 
just as are the FSC for a periodic signals. 


Questions 


1. 


11. 


12. 


What is the conceptual difference between the Fourier series and the Fourier 
transform? 


. Why is the CTFT continuous? Why are the CTFSC coefficients discrete? 
. What is the CIFT magnitude of these impulse functions: 


6(t—1), 6(t—2), (tT). 


. Give the expression for the CTFT of a cosine and a sine. What is the difference 


between the two? 


. Given a sinusoid of frequency 5 Hz. What does its CTFT look like? 
. What is the difference between the Fourier transform magnitude of a sine and a 


cosine of equal amplitudes? 


. What is the CTFT (amplitude) of these sinusoids: sin(—800rt) , —cos(250zt) , 


0.25 sin(25t). What is the magnitude spectrum of these sinusoids? 


. What is the value of sin(5007t)6(t), cos(1007t)6(t — 7)? 
. What is the CTFT of: x(t) = 6sin(10zt) — 4cos(47t)? 
. If the FT of a signal is being multiplied by this CE: e~/°*/, what is the resultant 


effect in time domain? 
We multiply a signal in time domain by this CE: e~/!*"", what is the effect in 
frequency domain on the FT of the signal? 


The summation of complex exponentials represents what function? 
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13. What is the value of cos(67tt)6(t — 4)? 

14. What is the CTFT of the constant 7? 

15. Asinc function crosses first zero at 7/B. What is its time domain equation? What 
does the spectrum look like and what is its bandwidth? 

16. A sinc function crosses first zero at t = 1, give its time domain equation? What 
does the spectrum look like and what is its bandwidth? 

17. What is the CTFT of sin(S5zt) « 6(t —5)? 

18. A signal of frequency 4 Hz is delayed by 10 s. By what CE do you multiply the 
unshifted CTFT to get the CTFT of the shifted signal? 

19. Given x(t) = sinc(t7), at what times does this function cross zeros? 

20. The first zero-crossing of a sinc function occurs at time = B s; 0.5 s; 2 s. What is 
the bandwidth of each of these three cases? 

21. What is the main lobe width of the CTFT of square pulses of widths: T,, T,/2, 
m/2, and 3 s. 

22. If the main lobe width of a sinc function (one sided) is equal to 2/2, then how 
wide is the square pulse in time? 

23. What is the CTFT of an impulse train with period equal to 0.5 s. Is this a periodic 
signal? 

24. Convolution in time domain of two sequences represents what in frequency domain? 

25. What is the Fourier transform of an impulse of amplitude 2 V in time domain? 

26. If a signal is shifted by 2 s, what happens to its CTFT? 

27. The CTFT of a periodic signal is continuous while the CTFSC is discrete. True or 
false? 

28. If the CTFSC of a signal at a particular harmonic is equal to 1/2, then what is the 
value obtained via CTFT at the same harmonic? 

29. Given the FSC of a signal, how do you calculate the FT of this signal? 

30. What is modulation and how is it accomplished? 

31. Why do the base-band and pass-band bandwidths of a signal differ? 
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